2024-04-17T14:14:06.827 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:14:06.827 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/orig.config.yaml 2024-04-17T14:14:06.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:14:06.967 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270 branch: wip-rishabh-testing-20240416.193735 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} email: null first_in_suite: false job_id: '7660270' kernel: client: branch: testing flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: a8c84f5997950fd7d008204839253291d52e6eda valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 3521 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 410/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCguLNMjncNpz3o8bS4UCM/sfrcef8c9AeqG0eeeU/AC/EJGgI4itrWpW0/vBSK0A5pdATltOpCH1kaC3XBgJ/A= smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtWG/r9XJQPeirGxJkjuzuMQpohPhCmGWLUGaEICj/xQl6TXT4bI8S9NLapM9mz/Bag3vdgJrTvwIgO2v+1CXk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_11:26:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T14:14:06.968 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-17T14:14:06.968 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-17T14:14:06.969 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T14:14:06.970 INFO:teuthology.task.internal:Checking packages... 2024-04-17T14:14:06.993 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-17T14:14:06.993 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T14:14:06.994 INFO:teuthology.packaging:ref: None 2024-04-17T14:14:06.994 INFO:teuthology.packaging:tag: None 2024-04-17T14:14:06.994 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-17T14:14:06.994 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:14:06.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-17T14:14:07.132 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:14:07.134 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T14:14:07.142 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T14:14:07.142 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T14:14:07.203 INFO:teuthology.task.internal:Saving configuration 2024-04-17T14:14:07.221 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T14:14:07.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T14:14:07.256 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 14:08:30.173082', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICDoQCPEujCnKkxV3LL4aSmMmfZXPIYUp0Jvs5ptiYcQ'} 2024-04-17T14:14:07.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 14:08:30.175219', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFcsXj5vkQqx9pb0bxeK+QU1vxo6AWk1hlTwsRwuW0Rz'} 2024-04-17T14:14:07.275 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T14:14:07.285 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-17T14:14:07.285 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-17T14:14:07.285 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T14:14:07.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82919804c0>, signals=[15]) 2024-04-17T14:14:07.363 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T14:14:07.373 INFO:teuthology.task.internal:Opening connections... 2024-04-17T14:14:07.373 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:14:07.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:07.455 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:14:07.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:07.534 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T14:14:07.544 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-17T14:14:07.549 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-17T14:14:07.549 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-17T14:14:07.594 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T14:14:07.594 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-04-17T14:14:07.594 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T14:14:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-04-17T14:14:07.596 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-17T14:14:07.629 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-04-17T14:14:07.634 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-04-17T14:14:07.635 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-04-17T14:14:07.680 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T14:14:07.680 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="22.04" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=jammy 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T14:14:07.681 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=jammy 2024-04-17T14:14:07.681 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-04-17T14:14:07.696 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T14:14:07.709 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T14:14:07.721 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T14:14:07.721 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-17T14:14:07.724 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-04-17T14:14:07.728 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T14:14:07.747 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T14:14:07.748 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-17T14:14:07.772 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-04-17T14:14:07.786 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T14:14:07.838 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T14:14:07.857 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-17T14:14:07.857 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-17T14:14:07.857 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-17T14:14:07.858 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T14:14:07.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:14:07.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-17T14:14:08.030 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T14:14:08.030 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T14:14:08.030 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-17T14:14:08.036 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-04-17T14:14:08.036 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T14:14:08.036 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T14:14:08.037 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-17T14:14:08.037 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-17T14:14:08.096 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-17T14:14:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-17T14:14:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-17T14:14:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-17T14:14:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-17T14:14:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git config --global init.defaultBranch 2024-04-17T14:14:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-17T14:14:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-17T14:14:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-17T14:14:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-17T14:14:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git branch -m 2024-04-17T14:14:08.236 INFO:teuthology.orchestra.run.smithi016.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-17T14:14:08.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-17T14:14:08.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-17T14:14:08.372 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-17T14:15:10.011 INFO:teuthology.orchestra.run.smithi016.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-17T14:15:10.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new branch] main -> origin/main 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190312 -> 20190312 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190416 -> 20190416 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190514 -> 20190514 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190618 -> 20190618 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190717 -> 20190717 2024-04-17T14:15:10.047 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190815 -> 20190815 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190923 -> 20190923 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191022 -> 20191022 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191215 -> 20191215 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200122 -> 20200122 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200316 -> 20200316 2024-04-17T14:15:10.048 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200421 -> 20200421 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200519 -> 20200519 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200619 -> 20200619 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200721 -> 20200721 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200817 -> 20200817 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200918 -> 20200918 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201022 -> 20201022 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201118 -> 20201118 2024-04-17T14:15:10.052 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201218 -> 20201218 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210208 -> 20210208 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210315 -> 20210315 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210511 -> 20210511 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210716 -> 20210716 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210818 -> 20210818 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210919 -> 20210919 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211027 -> 20211027 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211216 -> 20211216 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220209 -> 20220209 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220310 -> 20220310 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220411 -> 20220411 2024-04-17T14:15:10.053 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220509 -> 20220509 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220610 -> 20220610 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220708 -> 20220708 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220815 -> 20220815 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220913 -> 20220913 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221012 -> 20221012 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221109 -> 20221109 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221214 -> 20221214 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230117 -> 20230117 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230210 -> 20230210 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230310 -> 20230310 2024-04-17T14:15:10.054 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230404 -> 20230404 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230515 -> 20230515 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230625 -> 20230625 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230804 -> 20230804 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230919 -> 20230919 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231030 -> 20231030 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231111 -> 20231111 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231211 -> 20231211 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240115 -> 20240115 2024-04-17T14:15:10.056 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240220 -> 20240220 2024-04-17T14:15:10.057 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240312 -> 20240312 2024-04-17T14:15:10.057 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240410 -> 20240410 2024-04-17T14:15:14.489 INFO:teuthology.orchestra.run.smithi016.stderr:Updating files: 48% (1736/3609) Updating files: 49% (1769/3609) Updating files: 50% (1805/3609) Updating files: 51% (1841/3609) Updating files: 52% (1877/3609) Updating files: 53% (1913/3609) Updating files: 54% (1949/3609) Updating files: 55% (1985/3609) Updating files: 56% (2022/3609) Updating files: 57% (2058/3609) Updating files: 58% (2094/3609) Updating files: 59% (2130/3609) Updating files: 60% (2166/3609) Updating files: 61% (2202/3609) Updating files: 61% (2221/3609) Updating files: 62% (2238/3609) Updating files: 63% (2274/3609) Updating files: 64% (2310/3609) Updating files: 65% (2346/3609) Updating files: 66% (2382/3609) Updating files: 67% (2419/3609) Updating files: 68% (2455/3609) Updating files: 69% (2491/3609) Updating files: 70% (2527/3609) Updating files: 71% (2563/3609) Updating files: 71% (2591/3609) Updating files: 72% (2599/3609) Updating files: 73% (2635/3609) Updating files: 74% (2671/3609) Updating files: 75% (2707/3609) Updating files: 76% (2743/3609) Updating files: 77% (2779/3609) Updating files: 78% (2816/3609) Updating files: 79% (2852/3609) Updating files: 80% (2888/3609) Updating files: 81% (2924/3609) Updating files: 82% (2960/3609) Updating files: 83% (2996/3609) Updating files: 83% (3016/3609) Updating files: 84% (3032/3609) Updating files: 85% (3068/3609) Updating files: 86% (3104/3609) Updating files: 87% (3140/3609) Updating files: 88% (3176/3609) Updating files: 89% (3213/3609) Updating files: 90% (3249/3609) Updating files: 91% (3285/3609) Updating files: 92% (3321/3609) Updating files: 93% (3357/3609) Updating files: 94% (3393/3609) Updating files: 95% (3429/3609) Updating files: 96% (3465/3609) Updating files: 97% (3501/3609) Updating files: 98% (3537/3609) Updating files: 99% (3573/3609) Updating files: 100% (3609/3609) Updating files: 100% (3609/3609), done. 2024-04-17T14:15:14.495 INFO:teuthology.orchestra.run.smithi016.stdout:HEAD is now at e6786998 Merge branch 'mt7922' into 'main' 2024-04-17T14:15:14.517 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-17T14:15:14.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T14:15:14.734 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T14:15:14.735 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-17T14:15:14.737 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-17T14:15:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17 14:15:17 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-17T14:15:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2024-04-17 14:15:17-- 2024-04-17T14:15:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 2.1s 2024-04-17T14:15:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 43M in 2.0s (21.8 MB/s) 2024-04-17T14:15:16.865 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-17T14:15:16.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo dpkg -i /tmp/linux-image.deb 2024-04-17T14:15:17.122 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-17T14:15:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-17T14:15:19.081 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-17T14:15:19.198 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T14:15:22.922 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T14:15:23.140 INFO:teuthology.orchestra.run.smithi016.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-17T14:15:45.253 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T14:15:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-17T14:15:45.589 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:45.612 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:45.885 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T14:15:45.895 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T14:15:45.958 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T14:15:45.964 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T14:15:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T14:15:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T14:15:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T14:15:46.142 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-17T14:15:46.314 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-deb -c /tmp/linux-image.deb 2024-04-17T14:15:46.322 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-17T14:15:46.322 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-17T14:15:46.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-17T14:15:46.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-17T14:15:46.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-17T14:15:46.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-17T14:15:46.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T14:15:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T14:15:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T14:15:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T14:15:46.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T14:15:46.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T14:15:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-17T14:15:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T14:15:46.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T14:15:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-17T14:15:46.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T14:15:46.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T14:15:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T14:15:46.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T14:15:46.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T14:15:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T14:15:46.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T14:15:46.447 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T14:15:46.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-17T14:15:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-17T14:15:46.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-17T14:15:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-17T14:15:46.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T14:15:46.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-17T14:15:46.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-17T14:15:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-17T14:15:46.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-17T14:15:46.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T14:15:46.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-17T14:15:46.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T14:15:46.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T14:15:46.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T14:15:46.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T14:15:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-17T14:15:46.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T14:15:46.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T14:15:46.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-17T14:15:46.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T14:15:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T14:15:46.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T14:15:46.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T14:15:46.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-17T14:15:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T14:15:46.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T14:15:46.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T14:15:46.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-17T14:15:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T14:15:46.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-17T14:15:46.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-17T14:15:46.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-17T14:15:46.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-17T14:15:46.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T14:15:46.482 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-17T14:15:46.482 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-17T14:15:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-17T14:15:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-17T14:15:46.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-17T14:15:46.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T14:15:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T14:15:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-17T14:15:46.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-17T14:15:46.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T14:15:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T14:15:46.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-17T14:15:46.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-17T14:15:46.522 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-17T14:15:46.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-17T14:15:46.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-17T14:15:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-17T14:15:46.526 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-17T14:15:46.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-17T14:15:46.528 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T14:15:46.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T14:15:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-17T14:15:46.531 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T14:15:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T14:15:46.533 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T14:15:46.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-17T14:15:46.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T14:15:46.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-17T14:15:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T14:15:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-17T14:15:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-17T14:15:46.540 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T14:15:46.541 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-17T14:15:46.541 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T14:15:46.569 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T14:15:46.569 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T14:15:46.570 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-17T14:15:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T14:15:46.572 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T14:15:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T14:15:46.574 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T14:15:46.575 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T14:15:46.576 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-17T14:15:46.577 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T14:15:46.578 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T14:15:46.579 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-17T14:15:46.580 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T14:15:46.581 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T14:15:46.582 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-17T14:15:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-17T14:15:46.584 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-17T14:15:46.585 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T14:15:46.586 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T14:15:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T14:15:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-17T14:15:46.589 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T14:15:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T14:15:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T14:15:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T14:15:46.593 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-17T14:15:46.594 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T14:15:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T14:15:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-17T14:15:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T14:15:46.598 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T14:15:46.599 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T14:15:46.600 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T14:15:46.600 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-17T14:15:46.634 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T14:15:46.635 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T14:15:46.636 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-17T14:15:46.637 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T14:15:46.638 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-17T14:15:46.639 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-17T14:15:46.640 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-17T14:15:46.641 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-17T14:15:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-17T14:15:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T14:15:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T14:15:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T14:15:46.646 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-17T14:15:46.647 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T14:15:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-17T14:15:46.649 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T14:15:46.650 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T14:15:46.651 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T14:15:46.652 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-17T14:15:46.653 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-17T14:15:46.654 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T14:15:46.655 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T14:15:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T14:15:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-17T14:15:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T14:15:46.659 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T14:15:46.660 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-17T14:15:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-17T14:15:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-17T14:15:46.663 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T14:15:46.664 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-17T14:15:46.665 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-17T14:15:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T14:15:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-17T14:15:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T14:15:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-17T14:15:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T14:15:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T14:15:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T14:15:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T14:15:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T14:15:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-17T14:15:46.711 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T14:15:46.712 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-17T14:15:46.713 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-17T14:15:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-17T14:15:46.715 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-17T14:15:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T14:15:46.717 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T14:15:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T14:15:46.719 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T14:15:46.720 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T14:15:46.721 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T14:15:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T14:15:46.723 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T14:15:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T14:15:46.725 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T14:15:46.726 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T14:15:46.727 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-17T14:15:46.728 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T14:15:46.729 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T14:15:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T14:15:46.731 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T14:15:46.732 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T14:15:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T14:15:46.734 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T14:15:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T14:15:46.736 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T14:15:46.737 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T14:15:46.738 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T14:15:46.739 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T14:15:46.740 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T14:15:46.741 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T14:15:46.742 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T14:15:46.743 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T14:15:46.744 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T14:15:46.745 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T14:15:46.747 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-17T14:15:46.747 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-17T14:15:46.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-17T14:15:46.749 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-17T14:15:46.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-17T14:15:46.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T14:15:46.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-17T14:15:46.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-17T14:15:46.755 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.756 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.756 DEBUG:teuthology.orchestra.run.smithi016:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-17T14:15:46.795 INFO:teuthology.orchestra.run.smithi016.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T14:15:46.796 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T14:15:46.796 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T14:15:46.796 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-17T14:15:46.796 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:46.796 DEBUG:teuthology.orchestra.run.smithi016:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-17T14:15:46.839 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-17T14:15:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-17T14:15:47.237 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T14:15:47.249 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-17T14:15:47.474 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:47.480 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:15:47.706 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T14:15:47.712 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T14:15:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T14:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T14:15:47.873 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T14:15:47.873 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T14:15:47.873 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T14:15:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-17T14:16:19.120 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-17T14:16:19.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:16:19.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:37.663 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-17T14:16:46.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:16:46.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:46.666 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T14:17:58.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:17:58.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:58.889 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-17T14:17:59.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:17:59.672 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T14:17:59.672 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-17T14:17:59.719 INFO:teuthology.orchestra.run.smithi016.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:17:59.720 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T14:17:59.720 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T14:17:59.720 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T14:18:00.720 DEBUG:teuthology.parallel:result is None 2024-04-17T14:18:00.721 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T14:18:00.731 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T14:18:00.731 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T14:18:00.735 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T14:18:00.741 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T14:18:00.750 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T14:18:00.772 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T14:18:00.772 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T14:18:00.787 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T14:18:00.809 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T14:18:00.815 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T14:18:00.815 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T14:18:00.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:18:00.845 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T14:18:00.848 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T14:18:00.905 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T14:18:00.921 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T14:18:00.921 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T14:18:00.941 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T14:18:00.943 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T14:18:00.950 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T14:18:00.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T14:18:00.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T14:18:00.978 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T14:18:00.987 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T14:18:00.987 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T14:18:01.019 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T14:18:01.025 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T14:18:01.080 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T14:18:01.133 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:18:01.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T14:18:01.202 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T14:18:01.210 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T14:18:01.258 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:18:01.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T14:18:01.315 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-17T14:18:01.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-04-17T14:18:01.409 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T14:18:01.417 INFO:teuthology.task.internal:Starting timer... 2024-04-17T14:18:01.417 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T14:18:01.431 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T14:18:01.455 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-04-17T14:18:01.455 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2024-04-17T14:18:01.455 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T14:18:01.455 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-17T14:18:01.455 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T14:18:01.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T14:18:01.478 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T14:18:01.494 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T14:18:01.495 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T14:25:46.693 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2024-04-17T14:25:46.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:25:46.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:25:46.802 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-17T14:25:46.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-17T14:25:46.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-17T14:25:46.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:25:47.014 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-04-17T14:25:47.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-17T14:25:47.115 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T14:25:47.127 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T14:25:47.127 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T14:25:47.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T14:25:47.131 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T14:25:47.131 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T14:25:47.168 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T14:25:47.168 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Command line: ntpd -gq 2024-04-17T14:25:47.168 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: ---------------------------------------------------- 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: corporation. Support and training for ntp-4 are 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: available at https://www.nwtime.org/support 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: ---------------------------------------------------- 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: proto: precision = 0.043 usec (-24) 2024-04-17T14:25:47.169 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: basedate set to 2022-02-04 2024-04-17T14:25:47.170 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: gps base set to 2022-02-06 (week 2196) 2024-04-17T14:25:47.170 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T14:25:47.170 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T14:25:47.171 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen normally on 4 lo [::1]:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-04-17T14:25:47.172 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:47 ntpd[17067]: Listening on routing socket on fd #22 for interface updates 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Command line: ntpd -gq 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: ---------------------------------------------------- 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: corporation. Support and training for ntp-4 are 2024-04-17T14:25:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: available at https://www.nwtime.org/support 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: ---------------------------------------------------- 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: proto: precision = 0.046 usec (-24) 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: basedate set to 2022-02-04 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: gps base set to 2022-02-06 (week 2196) 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T14:25:47.185 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T14:25:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T14:25:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T14:25:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T14:25:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T14:25:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2024-04-17T14:25:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen normally on 4 lo [::1]:123 2024-04-17T14:25:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2024-04-17T14:25:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:47 ntpd[17618]: Listening on routing socket on fd #22 for interface updates 2024-04-17T14:25:48.168 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:48 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:48.168 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:48 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:48.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:48.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:48.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:48.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:48.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:48.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:48 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:49.168 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:49.168 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:49.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:49.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:49.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:49.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:49 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:50.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:50.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:50 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:51.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:51.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:51.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:51.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:51 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:52 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:52.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:52.187 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:52 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:53.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:53 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:54.168 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:54.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:54 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stdout:17 Apr 14:25:54 ntpd[17618]: ntpd: time slew -0.003508 s 2024-04-17T14:25:54.185 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.003508s 2024-04-17T14:25:54.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T14:25:54.186 INFO:teuthology.orchestra.run.smithi067.stderr:17 Apr 14:25:54 ntpd[17618]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stdout:17 Apr 14:25:55 ntpd[17067]: ntpd: time slew -0.002586 s 2024-04-17T14:25:55.170 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.002586s 2024-04-17T14:25:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T14:25:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:17 Apr 14:25:55 ntpd[17067]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T14:25:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T14:25:55.256 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-17T14:25:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:55.256 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:55.257 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T14:25:55.258 INFO:teuthology.run_tasks:Running task install... 2024-04-17T14:25:55.267 DEBUG:teuthology.task.install:project ceph 2024-04-17T14:25:55.268 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-17T14:25:55.268 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-17T14:25:55.268 INFO:teuthology.task.install:Using flavor: default 2024-04-17T14:25:55.274 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-17T14:25:55.274 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-17T14:25:55.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-04-17T14:25:55.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2024-04-17T14:25:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T14:25:55.371 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T14:25:55.372 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T14:25:55.372 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T14:25:55.372 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T14:25:55.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:25:55.409 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T14:25:55.461 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T14:25:55.462 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T14:25:55.463 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T14:25:55.463 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T14:25:55.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:25:55.514 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default/ 2024-04-17T14:25:55.514 INFO:teuthology.task.install.deb:Package version is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:25:55.678 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default/ 2024-04-17T14:25:55.678 INFO:teuthology.task.install.deb:Package version is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:25:55.698 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:25:55.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T14:25:55.713 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-04-17T14:25:55.789 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:25:55.789 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T14:25:55.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-17T14:25:55.891 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T14:25:55.891 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T14:25:55.911 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T14:25:55.931 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T14:25:55.937 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T14:25:55.958 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T14:25:55.980 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T14:25:56.000 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-17T14:25:56.004 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T14:25:56.027 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T14:25:56.110 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T14:25:56.112 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T14:25:56.147 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T14:25:56.184 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T14:25:56.194 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T14:25:56.220 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T14:25:56.258 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 29.2 kB in 0s (81.3 kB/s) 2024-04-17T14:25:56.267 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-17T14:25:56.275 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T14:25:56.614 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 29.2 kB in 1s (50.7 kB/s) 2024-04-17T14:25:57.241 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-04-17T14:25:57.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3133-ga8c84f59-1jammy cephadm=19.0.0-3133-ga8c84f59-1jammy ceph-mds=19.0.0-3133-ga8c84f59-1jammy ceph-mgr=19.0.0-3133-ga8c84f59-1jammy ceph-common=19.0.0-3133-ga8c84f59-1jammy ceph-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-test=19.0.0-3133-ga8c84f59-1jammy ceph-volume=19.0.0-3133-ga8c84f59-1jammy radosgw=19.0.0-3133-ga8c84f59-1jammy python3-rados=19.0.0-3133-ga8c84f59-1jammy python3-rgw=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy python3-rbd=19.0.0-3133-ga8c84f59-1jammy libcephfs2=19.0.0-3133-ga8c84f59-1jammy libcephfs-dev=19.0.0-3133-ga8c84f59-1jammy librados2=19.0.0-3133-ga8c84f59-1jammy librbd1=19.0.0-3133-ga8c84f59-1jammy rbd-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-common-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-fuse-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mds-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mgr-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mon-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-osd-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-test-dbg=19.0.0-3133-ga8c84f59-1jammy libcephfs2-dbg=19.0.0-3133-ga8c84f59-1jammy librados2-dbg=19.0.0-3133-ga8c84f59-1jammy libradosstriper1-dbg=19.0.0-3133-ga8c84f59-1jammy librbd1-dbg=19.0.0-3133-ga8c84f59-1jammy librgw2-dbg=19.0.0-3133-ga8c84f59-1jammy radosgw-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-fuse-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-mirror-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-nbd-dbg=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy cephfs-shell=19.0.0-3133-ga8c84f59-1jammy cephfs-top=19.0.0-3133-ga8c84f59-1jammy cephfs-mirror=19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:25:57.321 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-04-17T14:25:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-04-17T14:25:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-04-17T14:25:57.653 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-17T14:25:57.668 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3133-ga8c84f59-1jammy cephadm=19.0.0-3133-ga8c84f59-1jammy ceph-mds=19.0.0-3133-ga8c84f59-1jammy ceph-mgr=19.0.0-3133-ga8c84f59-1jammy ceph-common=19.0.0-3133-ga8c84f59-1jammy ceph-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-test=19.0.0-3133-ga8c84f59-1jammy ceph-volume=19.0.0-3133-ga8c84f59-1jammy radosgw=19.0.0-3133-ga8c84f59-1jammy python3-rados=19.0.0-3133-ga8c84f59-1jammy python3-rgw=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy python3-rbd=19.0.0-3133-ga8c84f59-1jammy libcephfs2=19.0.0-3133-ga8c84f59-1jammy libcephfs-dev=19.0.0-3133-ga8c84f59-1jammy librados2=19.0.0-3133-ga8c84f59-1jammy librbd1=19.0.0-3133-ga8c84f59-1jammy rbd-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-common-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-fuse-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mds-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mgr-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-mon-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-osd-dbg=19.0.0-3133-ga8c84f59-1jammy ceph-test-dbg=19.0.0-3133-ga8c84f59-1jammy libcephfs2-dbg=19.0.0-3133-ga8c84f59-1jammy librados2-dbg=19.0.0-3133-ga8c84f59-1jammy libradosstriper1-dbg=19.0.0-3133-ga8c84f59-1jammy librbd1-dbg=19.0.0-3133-ga8c84f59-1jammy librgw2-dbg=19.0.0-3133-ga8c84f59-1jammy radosgw-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-fuse-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-mirror-dbg=19.0.0-3133-ga8c84f59-1jammy rbd-nbd-dbg=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy cephfs-shell=19.0.0-3133-ga8c84f59-1jammy cephfs-top=19.0.0-3133-ga8c84f59-1jammy cephfs-mirror=19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:25:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T14:25:57.725 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T14:25:57.725 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T14:25:57.726 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T14:25:57.726 INFO:teuthology.orchestra.run.smithi067.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T14:25:57.726 INFO:teuthology.orchestra.run.smithi067.stdout: python2.7-minimal 2024-04-17T14:25:57.726 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T14:25:57.728 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T14:25:57.729 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T14:25:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T14:25:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T14:25:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T14:25:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T14:25:57.731 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2024-04-17T14:25:57.731 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2024-04-17T14:25:57.745 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-17T14:25:57.866 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi067.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-17T14:25:57.868 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-17T14:25:57.927 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-17T14:25:57.928 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-17T14:25:58.055 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 142 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T14:25:58.055 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 3,924 MB of archives. 2024-04-17T14:25:58.055 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 4,837 MB of additional disk space will be used. 2024-04-17T14:25:58.055 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T14:25:58.091 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3133-ga8c84f59-1jammy [3,555 kB] 2024-04-17T14:25:58.116 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T14:25:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T14:25:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T14:25:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T14:25:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T14:25:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T14:25:58.117 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T14:25:58.117 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-17T14:25:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T14:25:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T14:25:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T14:25:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T14:25:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-17T14:25:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-04-17T14:25:58.137 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T14:25:58.183 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T14:25:58.316 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T14:25:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T14:25:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-17T14:25:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-17T14:25:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-17T14:25:58.385 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T14:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T14:25:58.494 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T14:25:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 142 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T14:25:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 3,924 MB of archives. 2024-04-17T14:25:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 4,837 MB of additional disk space will be used. 2024-04-17T14:25:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T14:25:58.521 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3133-ga8c84f59-1jammy [3,224 kB] 2024-04-17T14:25:58.546 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T14:25:58.597 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T14:25:58.610 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3133-ga8c84f59-1jammy [3,555 kB] 2024-04-17T14:25:58.642 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T14:25:58.719 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T14:25:58.728 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T14:25:58.759 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T14:25:58.768 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T14:25:58.809 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3133-ga8c84f59-1jammy [716 kB] 2024-04-17T14:25:58.844 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T14:25:58.870 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3133-ga8c84f59-1jammy [356 kB] 2024-04-17T14:25:58.884 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3133-ga8c84f59-1jammy [32.8 kB] 2024-04-17T14:25:58.886 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3133-ga8c84f59-1jammy [180 kB] 2024-04-17T14:25:58.897 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3133-ga8c84f59-1jammy [66.9 kB] 2024-04-17T14:25:58.899 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3133-ga8c84f59-1jammy [330 kB] 2024-04-17T14:25:58.932 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T14:25:58.938 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T14:25:58.947 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3133-ga8c84f59-1jammy [6,890 kB] 2024-04-17T14:25:58.951 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T14:25:59.003 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T14:25:59.177 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T14:25:59.186 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T14:25:59.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T14:25:59.223 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T14:25:59.342 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3133-ga8c84f59-1jammy [112 kB] 2024-04-17T14:25:59.345 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3133-ga8c84f59-1jammy [466 kB] 2024-04-17T14:25:59.358 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3133-ga8c84f59-1jammy [25.8 MB] 2024-04-17T14:25:59.386 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T14:25:59.506 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T14:25:59.521 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T14:25:59.537 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T14:25:59.546 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T14:25:59.546 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T14:25:59.562 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T14:25:59.600 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T14:25:59.614 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T14:25:59.617 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T14:25:59.618 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T14:25:59.788 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T14:25:59.871 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T14:25:59.890 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T14:25:59.953 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T14:25:59.969 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T14:25:59.984 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T14:25:59.988 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T14:26:00.000 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T14:26:00.008 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T14:26:00.009 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T14:26:00.009 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T14:26:00.019 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3133-ga8c84f59-1jammy [3,224 kB] 2024-04-17T14:26:00.025 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T14:26:00.034 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T14:26:00.063 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T14:26:00.077 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T14:26:00.080 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T14:26:00.080 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T14:26:00.218 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T14:26:00.234 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T14:26:00.241 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T14:26:00.246 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T14:26:00.251 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T14:26:00.334 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T14:26:00.356 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T14:26:00.415 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T14:26:00.431 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T14:26:00.459 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T14:26:00.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T14:26:00.503 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T14:26:00.514 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T14:26:00.530 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T14:26:00.675 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T14:26:00.691 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T14:26:00.698 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T14:26:00.703 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T14:26:00.715 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T14:26:00.767 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T14:26:00.780 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T14:26:00.888 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T14:26:00.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T14:26:00.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T14:26:00.970 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T14:26:00.977 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T14:26:00.985 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3133-ga8c84f59-1jammy [716 kB] 2024-04-17T14:26:00.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T14:26:00.997 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T14:26:01.009 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T14:26:01.010 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3133-ga8c84f59-1jammy [5,092 kB] 2024-04-17T14:26:01.171 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T14:26:01.176 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T14:26:01.198 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3133-ga8c84f59-1jammy [356 kB] 2024-04-17T14:26:01.222 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T14:26:01.235 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T14:26:01.237 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3133-ga8c84f59-1jammy [244 kB] 2024-04-17T14:26:01.268 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T14:26:01.272 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3133-ga8c84f59-1jammy [1,529 kB] 2024-04-17T14:26:01.294 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3133-ga8c84f59-1jammy [32.8 kB] 2024-04-17T14:26:01.295 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3133-ga8c84f59-1jammy [180 kB] 2024-04-17T14:26:01.346 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3133-ga8c84f59-1jammy [66.9 kB] 2024-04-17T14:26:01.365 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3133-ga8c84f59-1jammy [6,259 kB] 2024-04-17T14:26:01.386 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3133-ga8c84f59-1jammy [330 kB] 2024-04-17T14:26:01.393 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T14:26:01.393 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T14:26:01.398 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T14:26:01.402 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T14:26:01.417 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T14:26:01.440 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T14:26:01.458 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3133-ga8c84f59-1jammy [6,890 kB] 2024-04-17T14:26:01.555 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T14:26:01.601 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T14:26:01.601 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T14:26:01.658 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3133-ga8c84f59-1jammy [22.8 MB] 2024-04-17T14:26:01.682 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T14:26:01.694 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T14:26:01.708 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T14:26:01.748 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T14:26:01.864 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T14:26:01.992 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T14:26:02.009 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T14:26:02.011 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T14:26:02.013 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T14:26:02.035 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T14:26:02.124 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T14:26:02.134 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T14:26:02.146 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T14:26:02.178 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T14:26:02.187 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T14:26:02.453 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T14:26:02.454 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T14:26:02.455 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T14:26:02.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T14:26:02.620 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T14:26:02.936 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T14:26:02.936 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3133-ga8c84f59-1jammy [14.0 kB] 2024-04-17T14:26:02.937 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [873 kB] 2024-04-17T14:26:02.940 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T14:26:02.941 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T14:26:02.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3133-ga8c84f59-1jammy [2,437 kB] 2024-04-17T14:26:02.963 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T14:26:02.991 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T14:26:02.991 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T14:26:02.993 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T14:26:03.018 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T14:26:03.019 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T14:26:03.099 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3133-ga8c84f59-1jammy [791 kB] 2024-04-17T14:26:03.158 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3133-ga8c84f59-1jammy [148 kB] 2024-04-17T14:26:03.179 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3133-ga8c84f59-1jammy [2,297 kB] 2024-04-17T14:26:03.185 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T14:26:03.245 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3133-ga8c84f59-1jammy [112 kB] 2024-04-17T14:26:03.282 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T14:26:03.294 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3133-ga8c84f59-1jammy [8,625 kB] 2024-04-17T14:26:03.294 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3133-ga8c84f59-1jammy [466 kB] 2024-04-17T14:26:03.364 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T14:26:03.374 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T14:26:03.374 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T14:26:03.376 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T14:26:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3133-ga8c84f59-1jammy [25.8 MB] 2024-04-17T14:26:03.444 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T14:26:03.444 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T14:26:03.445 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T14:26:03.446 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T14:26:03.447 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T14:26:03.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T14:26:03.612 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T14:26:03.622 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T14:26:03.665 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T14:26:03.682 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3133-ga8c84f59-1jammy [14.2 kB] 2024-04-17T14:26:03.684 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3133-ga8c84f59-1jammy [51.7 MB] 2024-04-17T14:26:03.689 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T14:26:03.697 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T14:26:03.741 INFO:teuthology.orchestra.run.smithi067.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T14:26:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T14:26:03.770 INFO:teuthology.orchestra.run.smithi067.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T14:26:03.777 INFO:teuthology.orchestra.run.smithi067.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T14:26:03.820 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T14:26:03.944 INFO:teuthology.orchestra.run.smithi067.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T14:26:04.148 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T14:26:04.196 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T14:26:04.222 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T14:26:04.231 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T14:26:04.277 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T14:26:04.302 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T14:26:04.305 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T14:26:04.311 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T14:26:04.314 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T14:26:04.474 INFO:teuthology.orchestra.run.smithi067.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T14:26:04.480 INFO:teuthology.orchestra.run.smithi067.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T14:26:04.511 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T14:26:04.521 INFO:teuthology.orchestra.run.smithi067.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T14:26:04.521 INFO:teuthology.orchestra.run.smithi067.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T14:26:04.527 INFO:teuthology.orchestra.run.smithi067.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T14:26:04.530 INFO:teuthology.orchestra.run.smithi067.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T14:26:04.570 INFO:teuthology.orchestra.run.smithi067.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T14:26:04.579 INFO:teuthology.orchestra.run.smithi067.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T14:26:04.652 INFO:teuthology.orchestra.run.smithi067.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T14:26:04.653 INFO:teuthology.orchestra.run.smithi067.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T14:26:04.768 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T14:26:04.819 INFO:teuthology.orchestra.run.smithi067.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T14:26:05.039 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T14:26:05.041 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T14:26:05.057 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T14:26:05.063 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T14:26:05.102 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T14:26:05.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T14:26:05.207 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T14:26:05.209 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T14:26:05.210 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T14:26:05.260 INFO:teuthology.orchestra.run.smithi067.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T14:26:05.276 INFO:teuthology.orchestra.run.smithi067.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T14:26:05.390 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T14:26:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T14:26:07.513 INFO:teuthology.orchestra.run.smithi067.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T14:26:07.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [232 kB] 2024-04-17T14:26:07.521 INFO:teuthology.orchestra.run.smithi067.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3133-ga8c84f59-1jammy [34.0 kB] 2024-04-17T14:26:07.522 INFO:teuthology.orchestra.run.smithi067.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3133-ga8c84f59-1jammy [23.4 kB] 2024-04-17T14:26:07.523 INFO:teuthology.orchestra.run.smithi067.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3133-ga8c84f59-1jammy [38.9 kB] 2024-04-17T14:26:07.525 INFO:teuthology.orchestra.run.smithi067.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3133-ga8c84f59-1jammy [13.6 MB] 2024-04-17T14:26:09.172 INFO:teuthology.orchestra.run.smithi067.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [91.4 kB] 2024-04-17T14:26:09.174 INFO:teuthology.orchestra.run.smithi067.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [3,124 kB] 2024-04-17T14:26:09.459 INFO:teuthology.orchestra.run.smithi067.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-3133-ga8c84f59-1jammy [179 kB] 2024-04-17T14:26:09.493 INFO:teuthology.orchestra.run.smithi067.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [783 MB] 2024-04-17T14:26:11.821 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3133-ga8c84f59-1jammy [5,092 kB] 2024-04-17T14:26:12.914 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3133-ga8c84f59-1jammy [244 kB] 2024-04-17T14:26:12.977 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T14:26:12.996 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3133-ga8c84f59-1jammy [1,529 kB] 2024-04-17T14:26:13.301 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3133-ga8c84f59-1jammy [6,259 kB] 2024-04-17T14:26:14.476 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3133-ga8c84f59-1jammy [22.8 MB] 2024-04-17T14:26:20.686 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3133-ga8c84f59-1jammy [14.0 kB] 2024-04-17T14:26:20.686 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [873 kB] 2024-04-17T14:26:21.040 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3133-ga8c84f59-1jammy [2,437 kB] 2024-04-17T14:26:21.830 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3133-ga8c84f59-1jammy [791 kB] 2024-04-17T14:26:22.151 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3133-ga8c84f59-1jammy [148 kB] 2024-04-17T14:26:22.189 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3133-ga8c84f59-1jammy [2,297 kB] 2024-04-17T14:26:23.121 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3133-ga8c84f59-1jammy [8,625 kB] 2024-04-17T14:26:25.302 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3133-ga8c84f59-1jammy [14.2 kB] 2024-04-17T14:26:25.303 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3133-ga8c84f59-1jammy [51.7 MB] 2024-04-17T14:26:39.563 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T14:26:39.578 INFO:teuthology.orchestra.run.smithi016.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [232 kB] 2024-04-17T14:26:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3133-ga8c84f59-1jammy [34.0 kB] 2024-04-17T14:26:39.619 INFO:teuthology.orchestra.run.smithi016.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3133-ga8c84f59-1jammy [23.4 kB] 2024-04-17T14:26:39.620 INFO:teuthology.orchestra.run.smithi016.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3133-ga8c84f59-1jammy [38.9 kB] 2024-04-17T14:26:39.645 INFO:teuthology.orchestra.run.smithi016.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3133-ga8c84f59-1jammy [13.6 MB] 2024-04-17T14:26:42.469 INFO:teuthology.orchestra.run.smithi016.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [91.4 kB] 2024-04-17T14:26:42.496 INFO:teuthology.orchestra.run.smithi016.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [3,124 kB] 2024-04-17T14:26:42.890 INFO:teuthology.orchestra.run.smithi016.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-3133-ga8c84f59-1jammy [179 kB] 2024-04-17T14:26:42.922 INFO:teuthology.orchestra.run.smithi016.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [783 MB] 2024-04-17T14:28:29.402 INFO:teuthology.orchestra.run.smithi067.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [19.0 MB] 2024-04-17T14:28:31.505 INFO:teuthology.orchestra.run.smithi067.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [86.7 MB] 2024-04-17T14:28:38.718 INFO:teuthology.orchestra.run.smithi067.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [42.9 MB] 2024-04-17T14:28:41.056 INFO:teuthology.orchestra.run.smithi067.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [159 MB] 2024-04-17T14:28:43.703 INFO:teuthology.orchestra.run.smithi016.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [19.0 MB] 2024-04-17T14:28:44.984 INFO:teuthology.orchestra.run.smithi016.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [86.7 MB] 2024-04-17T14:28:50.361 INFO:teuthology.orchestra.run.smithi067.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [542 MB] 2024-04-17T14:28:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [42.9 MB] 2024-04-17T14:28:58.266 INFO:teuthology.orchestra.run.smithi016.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [159 MB] 2024-04-17T14:29:18.178 INFO:teuthology.orchestra.run.smithi016.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [542 MB] 2024-04-17T14:29:24.061 INFO:teuthology.orchestra.run.smithi067.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [1,235 MB] 2024-04-17T14:30:05.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [1,235 MB] 2024-04-17T14:31:32.299 INFO:teuthology.orchestra.run.smithi067.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [17.2 MB] 2024-04-17T14:31:33.279 INFO:teuthology.orchestra.run.smithi067.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [83.3 MB] 2024-04-17T14:31:38.155 INFO:teuthology.orchestra.run.smithi067.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [11.4 MB] 2024-04-17T14:31:38.579 INFO:teuthology.orchestra.run.smithi067.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [104 MB] 2024-04-17T14:31:48.837 INFO:teuthology.orchestra.run.smithi067.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [187 MB] 2024-04-17T14:32:07.523 INFO:teuthology.orchestra.run.smithi067.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [366 MB] 2024-04-17T14:32:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [17.2 MB] 2024-04-17T14:32:14.791 INFO:teuthology.orchestra.run.smithi016.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [83.3 MB] 2024-04-17T14:32:22.891 INFO:teuthology.orchestra.run.smithi016.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [11.4 MB] 2024-04-17T14:32:24.186 INFO:teuthology.orchestra.run.smithi016.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [104 MB] 2024-04-17T14:32:37.992 INFO:teuthology.orchestra.run.smithi016.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [187 MB] 2024-04-17T14:32:44.651 INFO:teuthology.orchestra.run.smithi067.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [1,794 kB] 2024-04-17T14:32:44.823 INFO:teuthology.orchestra.run.smithi067.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [97.7 MB] 2024-04-17T14:32:59.110 INFO:teuthology.orchestra.run.smithi067.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [3,147 kB] 2024-04-17T14:32:59.809 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 3,924 MB in 7min 1s (9,314 kB/s) 2024-04-17T14:33:00.086 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T14:33:00.163 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-17T14:33:00.167 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T14:33:00.202 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T14:33:00.529 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T14:33:00.550 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T14:33:00.596 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T14:33:00.974 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T14:33:00.995 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T14:33:01.040 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T14:33:01.468 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T14:33:01.489 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T14:33:01.594 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T14:33:02.014 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T14:33:02.034 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T14:33:02.080 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T14:33:02.433 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T14:33:02.454 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T14:33:02.491 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T14:33:03.045 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T14:33:03.066 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:33:03.120 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:33:03.606 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T14:33:03.628 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:33:03.673 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:33:04.067 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T14:33:04.088 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:33:04.125 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:33:04.522 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T14:33:04.543 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T14:33:04.614 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T14:33:05.000 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2. 2024-04-17T14:33:05.021 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../010-librados2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:05.058 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:05.519 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1. 2024-04-17T14:33:05.540 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../011-librbd1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:05.586 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:06.097 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T14:33:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:06.164 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:06.491 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2024-04-17T14:33:06.512 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:06.558 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:06.919 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T14:33:06.940 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:06.977 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:07.247 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T14:33:07.267 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:07.313 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:07.708 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T14:33:07.728 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:07.774 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:07.807 INFO:teuthology.orchestra.run.smithi016.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [366 MB] 2024-04-17T14:33:08.085 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T14:33:08.106 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T14:33:08.144 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T14:33:08.355 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T14:33:08.367 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:08.397 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:08.749 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T14:33:08.770 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T14:33:08.807 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T14:33:09.102 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T14:33:09.122 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T14:33:09.160 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T14:33:09.463 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T14:33:09.475 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T14:33:09.521 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T14:33:09.833 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua5.1. 2024-04-17T14:33:09.854 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T14:33:09.891 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T14:33:10.219 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-any. 2024-04-17T14:33:10.231 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T14:33:10.285 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T14:33:10.529 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package zip. 2024-04-17T14:33:10.542 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T14:33:10.580 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T14:33:10.832 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package unzip. 2024-04-17T14:33:10.845 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T14:33:10.874 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T14:33:11.269 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package luarocks. 2024-04-17T14:33:11.291 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T14:33:11.328 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T14:33:11.736 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2024-04-17T14:33:11.757 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../027-librgw2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:11.794 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:12.363 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T14:33:12.384 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:12.422 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:12.707 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T14:33:12.720 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T14:33:12.749 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T14:33:13.035 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T14:33:13.056 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:13.093 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:13.522 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2024-04-17T14:33:13.543 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:13.588 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:14.994 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2024-04-17T14:33:15.014 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:15.053 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:15.623 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T14:33:15.635 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T14:33:15.664 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T14:33:16.350 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T14:33:16.371 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T14:33:16.409 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T14:33:16.736 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T14:33:16.757 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T14:33:16.795 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T14:33:17.073 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T14:33:17.094 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T14:33:17.131 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T14:33:17.434 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T14:33:17.454 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T14:33:17.492 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T14:33:17.795 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T14:33:17.816 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T14:33:17.853 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T14:33:18.131 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-portend. 2024-04-17T14:33:18.143 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T14:33:18.172 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T14:33:18.459 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T14:33:18.480 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T14:33:18.517 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T14:33:18.820 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T14:33:18.841 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T14:33:18.878 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T14:33:19.232 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T14:33:19.253 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T14:33:19.290 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T14:33:19.601 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T14:33:19.622 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T14:33:19.659 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T14:33:19.945 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T14:33:19.967 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T14:33:20.003 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T14:33:20.357 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2024-04-17T14:33:20.378 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T14:33:20.406 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T14:33:20.718 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T14:33:20.739 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T14:33:20.768 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T14:33:21.112 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T14:33:21.133 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T14:33:21.179 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T14:33:21.490 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2024-04-17T14:33:21.511 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T14:33:21.556 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T14:33:21.868 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T14:33:21.890 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T14:33:21.921 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T14:33:22.212 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T14:33:22.233 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T14:33:22.270 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T14:33:22.574 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2024-04-17T14:33:22.595 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T14:33:22.632 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T14:33:22.926 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T14:33:22.939 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T14:33:22.977 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T14:33:23.312 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T14:33:23.334 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T14:33:23.370 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T14:33:23.657 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T14:33:23.678 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T14:33:23.715 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T14:33:24.010 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T14:33:24.031 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T14:33:24.068 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T14:33:24.406 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T14:33:24.427 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T14:33:24.464 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T14:33:24.770 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-idna. 2024-04-17T14:33:24.780 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T14:33:24.817 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T14:33:25.136 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T14:33:25.158 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T14:33:25.194 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T14:33:25.523 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests. 2024-04-17T14:33:25.544 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T14:33:25.606 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T14:33:25.917 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T14:33:25.939 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T14:33:25.975 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T14:33:26.270 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T14:33:26.282 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:26.320 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:26.700 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T14:33:26.713 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:26.749 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:27.069 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T14:33:27.090 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T14:33:27.128 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T14:33:27.413 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T14:33:27.435 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T14:33:27.471 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T14:33:27.817 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T14:33:27.838 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:27.874 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:28.253 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T14:33:28.274 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:28.311 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:28.889 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T14:33:28.911 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:28.955 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:30.034 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2024-04-17T14:33:30.056 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../068-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:30.100 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:30.420 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T14:33:30.441 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:30.478 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:30.856 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T14:33:30.878 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:30.922 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:31.326 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2024-04-17T14:33:31.347 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../071-cephadm_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:31.384 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:31.704 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T14:33:31.725 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T14:33:31.770 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T14:33:32.131 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T14:33:32.143 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T14:33:32.181 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T14:33:33.237 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-babel. 2024-04-17T14:33:33.258 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T14:33:33.311 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T14:33:33.706 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T14:33:33.727 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T14:33:33.772 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T14:33:34.192 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T14:33:34.214 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:34.267 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:34.637 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T14:33:34.659 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T14:33:34.695 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T14:33:34.998 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2024-04-17T14:33:35.020 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T14:33:35.065 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T14:33:35.418 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T14:33:35.440 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:35.485 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:36.665 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T14:33:36.687 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T14:33:36.731 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T14:33:37.243 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T14:33:37.265 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T14:33:37.302 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T14:33:37.663 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T14:33:37.685 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T14:33:37.815 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T14:33:38.126 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T14:33:38.148 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T14:33:38.185 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T14:33:38.968 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T14:33:38.991 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:39.035 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:39.988 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T14:33:40.009 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T14:33:40.046 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T14:33:40.265 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T14:33:40.278 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T14:33:40.316 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T14:33:40.594 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T14:33:40.616 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T14:33:40.644 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T14:33:40.897 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T14:33:40.909 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T14:33:40.947 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T14:33:41.276 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T14:33:41.297 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T14:33:41.342 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T14:33:41.679 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T14:33:41.700 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T14:33:41.745 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T14:33:42.056 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T14:33:42.078 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T14:33:42.123 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T14:33:42.460 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T14:33:42.481 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T14:33:42.526 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T14:33:43.190 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T14:33:43.203 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:43.240 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:43.561 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T14:33:43.583 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T14:33:43.628 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T14:33:43.931 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T14:33:43.952 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T14:33:43.989 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T14:33:44.258 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2024-04-17T14:33:44.280 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T14:33:44.324 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T14:33:44.578 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2024-04-17T14:33:44.599 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T14:33:44.644 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T14:33:44.989 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T14:33:45.003 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T14:33:45.057 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T14:33:45.426 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2024-04-17T14:33:45.440 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:45.484 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:47.925 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T14:33:47.944 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:47.988 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:48.367 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T14:33:48.389 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:48.434 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:48.762 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T14:33:48.784 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T14:33:48.829 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T14:33:49.081 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T14:33:49.094 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:49.132 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T14:33:49.363 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:33:49.392 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:49.628 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T14:33:49.641 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:49.678 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T14:33:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T14:33:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T14:33:50.452 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T14:33:50.473 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T14:33:50.518 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T14:33:50.864 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T14:33:50.886 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T14:33:50.931 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T14:33:51.352 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pkg-config. 2024-04-17T14:33:51.375 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T14:33:51.427 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T14:33:51.697 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T14:33:51.719 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T14:33:51.763 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T14:33:52.208 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T14:33:52.230 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T14:33:52.274 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T14:33:52.577 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T14:33:52.599 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T14:33:52.644 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T14:33:52.981 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T14:33:53.003 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T14:33:53.049 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T14:33:53.325 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T14:33:53.338 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T14:33:53.366 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T14:33:53.711 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2024-04-17T14:33:53.734 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T14:33:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T14:33:54.106 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T14:33:54.131 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T14:33:54.172 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T14:33:54.585 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T14:33:54.607 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T14:33:54.643 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T14:33:54.904 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-toml. 2024-04-17T14:33:54.927 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T14:33:54.970 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T14:33:55.290 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T14:33:55.313 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T14:33:55.357 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T14:33:55.652 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T14:33:55.674 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T14:33:55.710 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T14:33:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T14:33:55.976 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T14:33:56.021 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T14:33:56.750 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2024-04-17T14:33:56.772 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../122-radosgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:56.816 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:57.694 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T14:33:57.716 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:57.770 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:58.097 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-mirror. 2024-04-17T14:33:58.119 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:58.163 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:58.575 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-nbd. 2024-04-17T14:33:58.588 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:58.624 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-nbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:33:58.877 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-17T14:33:58.899 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:33:58.943 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:06.873 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-17T14:34:06.886 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:06.914 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:07.358 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-17T14:34:07.380 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:07.424 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:08.527 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-17T14:34:08.540 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:08.585 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:09.338 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-17T14:34:09.360 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:09.404 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:11.198 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-17T14:34:11.211 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:11.239 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:16.617 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-17T14:34:16.631 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:16.676 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:28.343 INFO:teuthology.orchestra.run.smithi016.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [1,794 kB] 2024-04-17T14:34:28.558 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-17T14:34:28.572 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:28.587 INFO:teuthology.orchestra.run.smithi016.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [97.7 MB] 2024-04-17T14:34:28.616 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:29.077 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2-dbg. 2024-04-17T14:34:29.091 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:29.135 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:30.146 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-17T14:34:30.160 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:30.582 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-17T14:34:30.595 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:30.623 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:31.934 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-17T14:34:31.947 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:31.984 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:33.969 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-17T14:34:33.982 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:34.019 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:37.430 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-17T14:34:37.443 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:37.480 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:37.749 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-17T14:34:37.766 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:37.807 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-mirror-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:39.226 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-17T14:34:39.249 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:39.293 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-nbd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:39.638 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T14:34:39.898 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T14:34:40.024 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T14:34:40.295 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T14:34:40.672 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T14:34:41.011 INFO:teuthology.orchestra.run.smithi016.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-3133-ga8c84f59-1jammy [3,147 kB] 2024-04-17T14:34:41.203 INFO:teuthology.orchestra.run.smithi067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T14:34:41.369 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:41.910 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2024-04-17T14:34:41.958 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 3,924 MB in 8min 43s (7,503 kB/s) 2024-04-17T14:34:42.058 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T14:34:42.245 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T14:34:42.313 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-17T14:34:42.319 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T14:34:42.334 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T14:34:42.352 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T14:34:42.594 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T14:34:42.720 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T14:34:42.738 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T14:34:42.751 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T14:34:42.804 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T14:34:43.004 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T14:34:43.124 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T14:34:43.138 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T14:34:43.182 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T14:34:43.280 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T14:34:43.381 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T14:34:43.528 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T14:34:43.542 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T14:34:43.628 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T14:34:43.700 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T14:34:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T14:34:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T14:34:44.073 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T14:34:44.085 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T14:34:44.353 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T14:34:44.485 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T14:34:44.500 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T14:34:44.551 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T14:34:44.621 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T14:34:44.897 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T14:34:45.113 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T14:34:45.128 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:34:45.149 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T14:34:45.188 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:34:45.417 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T14:34:45.617 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T14:34:45.632 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:34:45.683 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:34:45.818 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T14:34:46.069 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:46.070 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T14:34:46.085 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T14:34:46.136 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:34:46.328 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T14:34:46.454 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T14:34:46.580 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T14:34:46.590 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T14:34:46.605 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T14:34:46.648 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T14:34:46.839 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T14:34:46.940 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T14:34:46.976 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-04-17T14:34:46.992 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librados2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T14:34:47.496 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-04-17T14:34:47.511 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librbd1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:47.554 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:47.627 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T14:34:47.680 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T14:34:47.736 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T14:34:47.854 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T14:34:47.940 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T14:34:47.955 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:47.998 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:48.230 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T14:34:48.285 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-04-17T14:34:48.300 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:48.331 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T14:34:48.343 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:48.582 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T14:34:48.679 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T14:34:48.695 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:34:48.738 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:48.860 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T14:34:48.957 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T14:34:48.972 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:49.008 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:49.193 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T14:34:49.318 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T14:34:49.318 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T14:34:49.333 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:34:49.385 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:49.755 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T14:34:49.770 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T14:34:49.812 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T14:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T14:34:50.057 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T14:34:50.072 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:50.115 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:50.330 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T14:34:50.456 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T14:34:50.460 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T14:34:50.475 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T14:34:50.518 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T14:34:50.582 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T14:34:50.796 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T14:34:50.811 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T14:34:50.854 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T14:34:50.908 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T14:34:51.166 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T14:34:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T14:34:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T14:34:51.301 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T14:34:51.502 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-04-17T14:34:51.517 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T14:34:51.552 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T14:34:51.577 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T14:34:51.898 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-04-17T14:34:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T14:34:51.955 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T14:34:51.987 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T14:34:52.233 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-04-17T14:34:52.248 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T14:34:52.283 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T14:34:52.288 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T14:34:52.587 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-04-17T14:34:52.602 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T14:34:52.631 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T14:34:52.645 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T14:34:52.974 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T14:34:53.033 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-04-17T14:34:53.048 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T14:34:53.091 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T14:34:53.233 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T14:34:53.359 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:53.499 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-04-17T14:34:53.514 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-librgw2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:53.549 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T14:34:53.970 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T14:34:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T14:34:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:54.060 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:54.396 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T14:34:54.412 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T14:34:54.479 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T14:34:54.791 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T14:34:54.806 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:54.841 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:55.201 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T14:34:55.203 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-04-17T14:34:55.218 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:55.270 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:55.444 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:34:55.578 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T14:34:55.846 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T14:34:55.972 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T14:34:56.073 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T14:34:56.392 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-04-17T14:34:56.399 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T14:34:56.408 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:34:56.459 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:34:56.676 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T14:34:56.919 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:34:57.013 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T14:34:57.027 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T14:34:57.044 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T14:34:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T14:34:57.371 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T14:34:57.374 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T14:34:57.389 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T14:34:57.432 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T14:34:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T14:34:57.735 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T14:34:57.751 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T14:34:57.796 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T14:34:57.890 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T14:34:58.124 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T14:34:58.139 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T14:34:58.157 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T14:34:58.182 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T14:34:58.417 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T14:34:58.485 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T14:34:58.500 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T14:34:58.543 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T14:34:58.676 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T14:34:58.802 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T14:34:58.855 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T14:34:58.870 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T14:34:58.913 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T14:34:59.087 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T14:34:59.213 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T14:34:59.249 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-04-17T14:34:59.264 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T14:34:59.307 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T14:34:59.556 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T14:34:59.560 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T14:34:59.575 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T14:34:59.610 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T14:34:59.857 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T14:34:59.896 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T14:34:59.912 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T14:34:59.955 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T14:35:00.135 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T14:35:00.261 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T14:35:00.300 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T14:35:00.315 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T14:35:00.358 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T14:35:00.387 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T14:35:00.475 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T14:35:00.644 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T14:35:00.660 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T14:35:00.702 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T14:35:00.713 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T14:35:00.839 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T14:35:01.031 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T14:35:01.046 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T14:35:01.089 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T14:35:01.233 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T14:35:01.384 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-04-17T14:35:01.399 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T14:35:01.442 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T14:35:01.509 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T14:35:01.627 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T14:35:01.787 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T14:35:01.802 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T14:35:01.836 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T14:35:01.877 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:35:01.995 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T14:35:02.131 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T14:35:02.147 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T14:35:02.189 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T14:35:02.321 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T14:35:02.476 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-04-17T14:35:02.491 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T14:35:02.534 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T14:35:02.639 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T14:35:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T14:35:02.910 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T14:35:02.915 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T14:35:02.948 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T14:35:03.135 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T14:35:03.224 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T14:35:03.239 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T14:35:03.273 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T14:35:03.411 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T14:35:03.559 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-04-17T14:35:03.575 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T14:35:03.618 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T14:35:03.671 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T14:35:03.904 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T14:35:03.919 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T14:35:03.930 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T14:35:03.971 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T14:35:04.241 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T14:35:04.256 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T14:35:04.299 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T14:35:04.315 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T14:35:04.602 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T14:35:04.609 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T14:35:04.617 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T14:35:04.660 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T14:35:04.971 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T14:35:04.977 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T14:35:04.986 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T14:35:05.029 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T14:35:05.078 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:05.221 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:05.347 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T14:35:05.409 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T14:35:05.424 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T14:35:05.467 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T14:35:05.683 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:05.809 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:05.927 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T14:35:06.004 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-04-17T14:35:06.019 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T14:35:06.062 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T14:35:06.212 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:06.313 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:06.365 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T14:35:06.380 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T14:35:06.415 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T14:35:06.439 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:06.565 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:06.693 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-04-17T14:35:06.708 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T14:35:06.724 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:06.743 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T14:35:06.951 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T14:35:06.952 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T14:35:06.979 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T14:35:06.994 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T14:35:07.113 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T14:35:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T14:35:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.509 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.635 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.761 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.879 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T14:35:07.879 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.894 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:07.937 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:07.980 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:08.106 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:08.232 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T14:35:08.232 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T14:35:08.247 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T14:35:08.290 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T14:35:08.576 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T14:35:08.591 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T14:35:08.634 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T14:35:08.937 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T14:35:08.953 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:08.987 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:09.357 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T14:35:09.373 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:09.415 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:09.521 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:09.628 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:09.769 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.019 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T14:35:10.034 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:10.077 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.272 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.398 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-nbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.549 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.675 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.780 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-04-17T14:35:10.793 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-nbd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.795 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:10.830 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.894 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:10.995 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:11.121 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:11.166 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T14:35:11.181 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:11.224 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:11.561 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T14:35:11.576 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:11.619 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:11.664 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2024-04-17T14:35:11.972 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-04-17T14:35:11.988 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-cephadm_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:12.008 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2024-04-17T14:35:12.021 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:12.209 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2024-04-17T14:35:12.228 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T14:35:12.333 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T14:35:12.349 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T14:35:12.375 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T14:35:12.383 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T14:35:12.660 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T14:35:12.676 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T14:35:12.710 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T14:35:12.762 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T14:35:13.322 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:13.543 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T14:35:13.543 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T14:35:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-04-17T14:35:13.730 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T14:35:13.774 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T14:35:14.085 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T14:35:14.098 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:14.099 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T14:35:14.143 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T14:35:14.225 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:14.488 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T14:35:14.502 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:14.546 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:14.763 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T14:35:14.763 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T14:35:14.916 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T14:35:14.931 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T14:35:14.974 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T14:35:15.261 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-04-17T14:35:15.276 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T14:35:15.310 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:15.311 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T14:35:15.647 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T14:35:15.663 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:15.705 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:15.868 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T14:35:16.397 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:16.650 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T14:35:16.651 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T14:35:16.911 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T14:35:16.925 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T14:35:16.993 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T14:35:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:17.480 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T14:35:17.495 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T14:35:17.521 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:17.547 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T14:35:17.773 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T14:35:17.773 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T14:35:17.867 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T14:35:17.882 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T14:35:18.002 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T14:35:18.319 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:18.330 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T14:35:18.346 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T14:35:18.388 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T14:35:18.523 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T14:35:18.523 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T14:35:19.031 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T14:35:19.046 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:19.081 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:19.103 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:19.204 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:19.331 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:19.456 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:19.770 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T14:35:19.771 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T14:35:20.035 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T14:35:20.048 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T14:35:20.093 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T14:35:20.333 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:20.395 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T14:35:20.411 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T14:35:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T14:35:20.459 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:20.585 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-mirror-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:20.711 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:20.824 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T14:35:20.837 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T14:35:20.880 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:20.882 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T14:35:21.031 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:21.194 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T14:35:21.207 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T14:35:21.251 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T14:35:21.251 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T14:35:21.251 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T14:35:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T14:35:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T14:35:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T14:35:21.807 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:21.892 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T14:35:21.905 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T14:35:21.942 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T14:35:21.958 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:22.101 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:22.237 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T14:35:22.250 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T14:35:22.252 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T14:35:22.361 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:22.623 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T14:35:22.636 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T14:35:22.690 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T14:35:22.706 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T14:35:22.840 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T14:35:22.993 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T14:35:23.362 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T14:35:23.374 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:23.412 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T14:35:23.731 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T14:35:23.746 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T14:35:23.789 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T14:35:24.100 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T14:35:24.113 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T14:35:24.151 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T14:35:24.357 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T14:35:24.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T14:35:24.403 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-04-17T14:35:24.416 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-04-17T14:35:24.417 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T14:35:24.462 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T14:35:24.617 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-04-17T14:35:24.618 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-04-17T14:35:24.699 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-04-17T14:35:24.712 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T14:35:24.756 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T14:35:24.818 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T14:35:24.819 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T14:35:24.819 INFO:teuthology.orchestra.run.smithi067.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T14:35:24.819 INFO:teuthology.orchestra.run.smithi067.stdout: python2.7-minimal 2024-04-17T14:35:24.819 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T14:35:24.820 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-04-17T14:35:24.820 INFO:teuthology.orchestra.run.smithi067.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T14:35:24.820 INFO:teuthology.orchestra.run.smithi067.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T14:35:24.820 INFO:teuthology.orchestra.run.smithi067.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T14:35:24.821 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T14:35:24.821 INFO:teuthology.orchestra.run.smithi067.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T14:35:24.822 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-04-17T14:35:24.822 INFO:teuthology.orchestra.run.smithi067.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T14:35:24.822 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T14:35:24.822 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T14:35:24.865 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-04-17T14:35:24.866 INFO:teuthology.orchestra.run.smithi067.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T14:35:24.866 INFO:teuthology.orchestra.run.smithi067.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T14:35:24.867 INFO:teuthology.orchestra.run.smithi067.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T14:35:24.867 INFO:teuthology.orchestra.run.smithi067.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T14:35:24.867 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T14:35:24.868 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T14:35:24.868 INFO:teuthology.orchestra.run.smithi067.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T14:35:24.869 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2024-04-17T14:35:24.869 INFO:teuthology.orchestra.run.smithi067.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T14:35:25.052 INFO:teuthology.orchestra.run.smithi067.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T14:35:25.052 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 55.7 MB of archives. 2024-04-17T14:35:25.052 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T14:35:25.052 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T14:35:25.059 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T14:35:25.074 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T14:35:25.117 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T14:35:25.505 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-04-17T14:35:25.518 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:25.563 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:25.685 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T14:35:25.701 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T14:35:25.827 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T14:35:25.828 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T14:35:25.829 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T14:35:25.858 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T14:35:25.859 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T14:35:25.863 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T14:35:25.866 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T14:35:25.871 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T14:35:26.038 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T14:35:26.318 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T14:35:26.328 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T14:35:26.334 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T14:35:26.418 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T14:35:27.511 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T14:35:27.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T14:35:27.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T14:35:27.522 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T14:35:27.571 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T14:35:27.582 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T14:35:27.601 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T14:35:27.615 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:27.658 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:27.750 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T14:35:28.071 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T14:35:28.086 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:28.129 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:28.340 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T14:35:28.340 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T14:35:28.408 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T14:35:28.422 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T14:35:28.457 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T14:35:28.520 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T14:35:28.520 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T14:35:28.559 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T14:35:28.617 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T14:35:28.623 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T14:35:28.624 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T14:35:28.625 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T14:35:28.626 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T14:35:28.685 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T14:35:28.699 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:28.734 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:28.831 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T14:35:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T14:35:29.035 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T14:35:29.079 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:29.241 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T14:35:29.331 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T14:35:29.346 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:29.389 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:29.684 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T14:35:29.695 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T14:35:29.734 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T14:35:30.010 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T14:35:30.046 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T14:35:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T14:35:30.094 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T14:35:30.095 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T14:35:30.095 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T14:35:30.096 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T14:35:30.096 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T14:35:30.113 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T14:35:30.125 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T14:35:30.126 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T14:35:30.476 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T14:35:30.486 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T14:35:30.525 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T14:35:30.552 INFO:teuthology.orchestra.run.smithi067.stdout:Preconfiguring packages ... 2024-04-17T14:35:30.714 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 55.7 MB in 5s (10.6 MB/s) 2024-04-17T14:35:30.914 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-04-17T14:35:30.924 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T14:35:30.955 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T14:35:31.020 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138800 files and directories currently installed.) 2024-04-17T14:35:31.025 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:35:31.192 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T14:35:31.202 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T14:35:31.268 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T14:35:31.293 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:35:31.636 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T14:35:31.647 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T14:35:31.686 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T14:35:31.921 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T14:35:31.989 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T14:35:32.000 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T14:35:32.039 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T14:35:32.359 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T14:35:32.373 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T14:35:32.417 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T14:35:32.762 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T14:35:32.773 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T14:35:32.812 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T14:35:32.954 INFO:teuthology.orchestra.run.smithi067.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T14:35:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-04-17T14:35:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T14:35:33.206 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T14:35:33.232 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package flex. 2024-04-17T14:35:33.323 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138800 files and directories currently installed.) 2024-04-17T14:35:33.328 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T14:35:33.472 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T14:35:33.535 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T14:35:33.546 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T14:35:33.584 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T14:35:34.025 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T14:35:34.038 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T14:35:34.049 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T14:35:34.088 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T14:35:34.211 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T14:35:34.332 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-04-17T14:35:34.343 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T14:35:34.385 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T14:35:34.620 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:35:34.687 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T14:35:34.699 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T14:35:34.737 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T14:35:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T14:35:35.110 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T14:35:35.113 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138873 files and directories currently installed.) 2024-04-17T14:35:35.117 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:35:35.149 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T14:35:35.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:35:35.393 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T14:35:35.405 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T14:35:35.452 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T14:35:35.655 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:35:35.783 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:35:36.110 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T14:35:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-04-17T14:35:36.199 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../122-radosgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:36.239 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:36.552 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package bison. 2024-04-17T14:35:36.644 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138873 files and directories currently installed.) 2024-04-17T14:35:36.649 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T14:35:36.695 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T14:35:37.104 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T14:35:37.127 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T14:35:37.171 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T14:35:37.241 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T14:35:37.253 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:37.283 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:37.549 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package dump. 2024-04-17T14:35:37.572 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T14:35:37.595 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-mirror. 2024-04-17T14:35:37.606 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:37.615 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T14:35:37.644 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:38.005 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-nbd. 2024-04-17T14:35:38.017 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:38.055 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-nbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:38.127 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package indent. 2024-04-17T14:35:38.141 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:38.186 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T14:35:38.316 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-17T14:35:38.327 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:38.391 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:38.405 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T14:35:38.419 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T14:35:38.455 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T14:35:38.767 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T14:35:38.790 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T14:35:38.825 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T14:35:39.070 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T14:35:39.093 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T14:35:39.137 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T14:35:39.482 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T14:35:39.504 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T14:35:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T14:35:39.792 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T14:35:39.815 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T14:35:39.859 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T14:35:40.095 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T14:35:40.109 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T14:35:40.145 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T14:35:40.457 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T14:35:40.479 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T14:35:40.523 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T14:35:42.827 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T14:35:42.850 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T14:35:42.893 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:35:43.146 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T14:35:43.162 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T14:35:43.188 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:35:43.508 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T14:35:43.530 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T14:35:43.574 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:35:43.927 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T14:35:43.950 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T14:35:43.993 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T14:35:44.338 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T14:35:44.361 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T14:35:44.396 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T14:35:44.725 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T14:35:44.747 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:44.791 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:35:45.177 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T14:35:45.200 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:45.243 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:35:45.563 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T14:35:45.576 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:45.613 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:35:45.711 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-17T14:35:45.723 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:45.823 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T14:35:45.837 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T14:35:45.873 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:35:46.389 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-17T14:35:46.393 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T14:35:46.401 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:46.417 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T14:35:46.439 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:46.452 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T14:35:46.780 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package modemmanager. 2024-04-17T14:35:46.803 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T14:35:46.847 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:35:47.512 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager. 2024-04-17T14:35:47.516 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-17T14:35:47.527 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:47.534 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T14:35:47.578 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T14:35:47.582 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:48.202 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-17T14:35:48.214 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:48.243 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:48.363 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ppp. 2024-04-17T14:35:48.385 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T14:35:48.686 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T14:35:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T14:35:49.049 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T14:35:49.092 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T14:35:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T14:35:49.368 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T14:35:49.412 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T14:35:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T14:35:49.746 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T14:35:49.790 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T14:35:50.004 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-17T14:35:50.016 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T14:35:50.083 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:50.087 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:50.118 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:35:50.790 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T14:35:50.813 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T14:35:50.875 INFO:teuthology.orchestra.run.smithi067.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T14:35:50.905 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-common (238) ... 2024-04-17T14:35:51.372 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T14:35:51.394 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:35:51.442 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:35:52.867 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql. 2024-04-17T14:35:52.891 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T14:35:52.933 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql (14+238) ... 2024-04-17T14:35:53.177 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T14:35:53.200 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T14:35:53.244 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T14:35:53.471 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T14:35:53.485 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T14:35:53.521 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T14:35:53.907 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T14:35:53.930 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T14:35:53.973 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T14:35:54.259 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl. 2024-04-17T14:35:54.282 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T14:35:54.340 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T14:35:54.457 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-17T14:35:54.468 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:35:54.506 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:35:54.687 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T14:35:54.710 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T14:35:54.754 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T14:35:55.125 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T14:35:55.138 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T14:35:55.166 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T14:35:55.536 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T14:35:55.559 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T14:35:55.611 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T14:35:55.897 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T14:35:56.109 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T14:35:56.226 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T14:35:56.327 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:35:56.462 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T14:35:56.588 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T14:35:56.739 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:35:57.204 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T14:35:57.285 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T14:35:57.637 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T14:35:57.637 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T14:35:58.297 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T14:35:58.439 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T14:35:58.566 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:35:58.692 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T14:35:58.818 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T14:35:58.919 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T14:35:59.036 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T14:35:59.162 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T14:35:59.826 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T14:35:59.949 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T14:36:00.037 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T14:36:00.104 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:36:00.230 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T14:36:00.356 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T14:36:00.491 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T14:36:00.600 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T14:36:00.691 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T14:36:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T14:36:00.886 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T14:36:01.062 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T14:36:01.188 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:36:01.314 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T14:36:01.483 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T14:36:01.592 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout:which means they are currently configured by ifupdown: 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout:- enp3s0f1 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T14:36:02.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:02.238 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T14:36:02.620 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T14:36:02.971 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T14:36:03.611 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:36:03.763 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T14:36:03.889 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T14:36:04.015 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-common (238) ... 2024-04-17T14:36:04.892 INFO:teuthology.orchestra.run.smithi067.stdout:Adding user postgres to group ssl-cert 2024-04-17T14:36:05.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:05.091 INFO:teuthology.orchestra.run.smithi067.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T14:36:05.257 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-17T14:36:05.269 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:05.314 INFO:teuthology.orchestra.run.smithi067.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T14:36:05.314 INFO:teuthology.orchestra.run.smithi067.stdout:Removing obsolete dictionary files: 2024-04-17T14:36:05.315 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:05.885 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2-dbg. 2024-04-17T14:36:05.896 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:05.934 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:05.952 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T14:36:06.384 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:36:06.719 INFO:teuthology.orchestra.run.smithi067.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T14:36:06.731 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T14:36:06.767 INFO:teuthology.orchestra.run.smithi067.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T14:36:06.767 INFO:teuthology.orchestra.run.smithi067.stdout:This user must also own the server process. 2024-04-17T14:36:06.767 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:06.767 INFO:teuthology.orchestra.run.smithi067.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:The default text search configuration will be set to "english". 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:Data page checksums are disabled. 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:creating subdirectories ... ok 2024-04-17T14:36:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T14:36:06.780 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default max_connections ... 100 2024-04-17T14:36:06.802 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default shared_buffers ... 128MB 2024-04-17T14:36:06.809 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default time zone ... Etc/UTC 2024-04-17T14:36:06.809 INFO:teuthology.orchestra.run.smithi067.stdout:creating configuration files ... ok 2024-04-17T14:36:06.920 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-17T14:36:06.927 INFO:teuthology.orchestra.run.smithi067.stdout:running bootstrap script ... ok 2024-04-17T14:36:06.931 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:06.970 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-17T14:36:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:07.593 INFO:teuthology.orchestra.run.smithi067.stdout:performing post-bootstrap initialization ... ok 2024-04-17T14:36:08.387 INFO:teuthology.orchestra.run.smithi067.stdout:syncing data to disk ... ok 2024-04-17T14:36:08.567 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-17T14:36:08.578 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:08.608 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:08.844 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T14:36:10.635 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-17T14:36:10.647 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:10.685 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:11.708 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:36:11.834 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T14:36:11.935 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql (14+238) ... 2024-04-17T14:36:12.086 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:36:12.212 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:36:12.474 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T14:36:12.475 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T14:36:13.156 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T14:36:13.249 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T14:36:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T14:36:13.703 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T14:36:13.979 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-17T14:36:13.991 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:14.029 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:14.307 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-17T14:36:14.318 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:14.365 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-mirror-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:15.599 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T14:36:15.692 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-17T14:36:15.704 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T14:36:15.714 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T14:36:15.734 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-nbd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:16.037 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T14:36:16.258 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T14:36:16.264 DEBUG:teuthology.parallel:result is None 2024-04-17T14:36:16.339 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T14:36:16.465 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T14:36:16.791 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T14:36:17.219 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T14:36:17.870 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T14:36:17.924 INFO:teuthology.orchestra.run.smithi016.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-17T14:36:17.976 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:18.838 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-04-17T14:36:19.016 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T14:36:19.334 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T14:36:19.636 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T14:36:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T14:36:20.112 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T14:36:20.414 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T14:36:20.549 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T14:36:20.875 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T14:36:21.298 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T14:36:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T14:36:21.888 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T14:36:22.206 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T14:36:22.499 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T14:36:22.767 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T14:36:23.052 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T14:36:23.353 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:23.654 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T14:36:23.821 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T14:36:23.972 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T14:36:24.274 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T14:36:24.425 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T14:36:24.693 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T14:36:25.086 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T14:36:25.140 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T14:36:25.213 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T14:36:25.364 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T14:36:25.782 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T14:36:25.908 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T14:36:26.209 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T14:36:26.502 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T14:36:26.845 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T14:36:26.996 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T14:36:27.782 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T14:36:28.074 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T14:36:28.217 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T14:36:28.368 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T14:36:28.752 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T14:36:29.187 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T14:36:29.480 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T14:36:29.940 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T14:36:30.258 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T14:36:30.601 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T14:36:30.985 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T14:36:31.286 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T14:36:31.446 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:31.789 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T14:36:32.165 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T14:36:33.471 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T14:36:33.748 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:36:34.007 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T14:36:34.284 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T14:36:34.426 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T14:36:34.560 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T14:36:34.904 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T14:36:35.205 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T14:36:35.529 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:36:35.682 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T14:36:36.008 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T14:36:36.301 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T14:36:36.602 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T14:36:36.937 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T14:36:37.230 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T14:36:37.539 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T14:36:37.682 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T14:36:37.983 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T14:36:38.109 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T14:36:38.444 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T14:36:38.795 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T14:36:39.121 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T14:36:39.272 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T14:36:39.415 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T14:36:39.504 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T14:36:39.767 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T14:36:39.893 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T14:36:40.319 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T14:36:40.620 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T14:36:40.771 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T14:36:41.073 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T14:36:41.199 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T14:36:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T14:36:41.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T14:36:42.194 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T14:36:42.431 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T14:36:42.732 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T14:36:43.017 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T14:36:43.642 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T14:36:44.062 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T14:36:44.388 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T14:36:44.766 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T14:36:44.909 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:45.076 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:45.336 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T14:36:45.738 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:45.890 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:46.024 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T14:36:46.326 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:46.468 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:46.619 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:46.770 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:46.921 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:47.166 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T14:36:47.166 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T14:36:47.831 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:47.958 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:48.083 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:48.243 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:48.406 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:48.578 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:48.729 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T14:36:50.100 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.226 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.369 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.520 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.671 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-nbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.821 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:50.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:51.166 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-nbd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:51.434 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:51.560 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:52.222 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-04-17T14:36:52.607 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-04-17T14:36:52.784 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-04-17T14:36:52.802 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T14:36:52.957 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T14:36:53.382 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T14:36:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:54.303 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T14:36:54.303 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T14:36:54.964 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:55.115 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:55.717 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T14:36:55.718 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T14:36:56.367 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:56.736 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T14:36:57.411 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:57.673 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T14:36:57.673 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T14:36:58.320 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:58.480 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:58.717 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T14:36:58.717 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T14:36:59.350 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:36:59.572 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T14:36:59.572 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T14:37:00.236 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:00.403 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:00.553 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:00.705 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:01.051 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T14:37:01.051 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T14:37:01.707 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:01.832 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:01.992 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-mirror-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:02.143 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:02.302 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:02.462 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:02.704 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T14:37:02.705 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T14:37:03.355 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:03.522 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:03.673 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:03.968 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon-dbg (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:04.119 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T14:37:04.530 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T14:37:04.639 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T14:37:04.783 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T14:37:05.835 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T14:37:06.582 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T14:37:06.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T14:37:06.663 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-17T14:37:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-17T14:37:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-17T14:37:07.018 INFO:teuthology.orchestra.run.smithi016.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T14:37:07.018 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T14:37:07.018 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T14:37:07.018 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T14:37:07.018 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T14:37:07.019 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T14:37:07.019 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T14:37:07.019 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T14:37:07.019 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T14:37:07.019 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T14:37:07.020 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-17T14:37:07.020 INFO:teuthology.orchestra.run.smithi016.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T14:37:07.020 INFO:teuthology.orchestra.run.smithi016.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T14:37:07.021 INFO:teuthology.orchestra.run.smithi016.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T14:37:07.021 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T14:37:07.021 INFO:teuthology.orchestra.run.smithi016.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T14:37:07.022 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-17T14:37:07.022 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T14:37:07.022 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T14:37:07.022 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T14:37:07.077 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-17T14:37:07.078 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T14:37:07.078 INFO:teuthology.orchestra.run.smithi016.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T14:37:07.079 INFO:teuthology.orchestra.run.smithi016.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T14:37:07.079 INFO:teuthology.orchestra.run.smithi016.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T14:37:07.079 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T14:37:07.079 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T14:37:07.079 INFO:teuthology.orchestra.run.smithi016.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T14:37:07.080 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-04-17T14:37:07.080 INFO:teuthology.orchestra.run.smithi016.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T14:37:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T14:37:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 55.7 MB of archives. 2024-04-17T14:37:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T14:37:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T14:37:07.936 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T14:37:07.952 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T14:37:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T14:37:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T14:37:08.080 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T14:37:08.108 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T14:37:08.109 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T14:37:08.113 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T14:37:08.115 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T14:37:08.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T14:37:08.282 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T14:37:08.575 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T14:37:08.585 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T14:37:08.590 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T14:37:08.673 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T14:37:09.640 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T14:37:09.642 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T14:37:09.642 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T14:37:09.667 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T14:37:09.668 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T14:37:09.673 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T14:37:09.839 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T14:37:10.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T14:37:10.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T14:37:10.628 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T14:37:10.628 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T14:37:10.667 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T14:37:10.728 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T14:37:10.733 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T14:37:10.734 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T14:37:10.736 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T14:37:10.736 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T14:37:10.943 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T14:37:11.361 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T14:37:12.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T14:37:12.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T14:37:12.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T14:37:12.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T14:37:12.117 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T14:37:12.117 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T14:37:12.145 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T14:37:12.145 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T14:37:12.542 INFO:teuthology.orchestra.run.smithi016.stdout:Preconfiguring packages ... 2024-04-17T14:37:12.702 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 55.7 MB in 5s (11.0 MB/s) 2024-04-17T14:37:12.990 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141218 files and directories currently installed.) 2024-04-17T14:37:12.994 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:37:13.134 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:37:13.818 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T14:37:15.295 INFO:teuthology.orchestra.run.smithi016.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T14:37:15.556 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2024-04-17T14:37:15.631 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141218 files and directories currently installed.) 2024-04-17T14:37:15.635 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T14:37:15.680 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T14:37:16.284 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T14:37:16.486 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T14:37:16.887 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:37:17.478 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141291 files and directories currently installed.) 2024-04-17T14:37:17.482 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:37:17.611 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:37:17.974 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T14:37:18.117 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T14:37:18.468 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T14:37:18.910 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2024-04-17T14:37:18.992 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141291 files and directories currently installed.) 2024-04-17T14:37:18.996 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T14:37:19.037 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T14:37:19.563 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T14:37:19.579 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T14:37:19.621 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T14:37:19.975 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2024-04-17T14:37:19.991 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T14:37:20.033 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T14:37:20.321 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2024-04-17T14:37:20.337 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:20.379 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T14:37:20.673 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T14:37:20.690 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T14:37:20.731 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T14:37:21.052 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T14:37:21.069 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T14:37:21.110 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T14:37:21.355 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T14:37:21.372 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T14:37:21.413 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T14:37:21.783 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T14:37:21.800 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T14:37:21.841 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T14:37:22.095 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T14:37:22.111 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T14:37:22.153 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T14:37:22.372 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T14:37:22.389 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T14:37:22.422 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T14:37:22.734 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T14:37:22.750 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T14:37:22.792 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T14:37:24.178 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T14:37:24.195 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T14:37:24.237 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:37:24.599 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T14:37:24.616 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T14:37:24.657 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:37:24.986 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T14:37:25.002 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T14:37:25.035 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:37:25.389 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T14:37:25.405 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T14:37:25.447 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T14:37:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T14:37:25.808 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T14:37:25.850 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T14:37:26.136 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T14:37:26.153 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:26.186 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:26.531 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T14:37:26.546 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:26.589 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:37:26.892 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T14:37:26.908 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:26.950 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:37:27.236 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T14:37:27.253 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T14:37:27.294 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:37:27.765 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T14:37:27.780 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T14:37:27.823 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T14:37:28.167 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package modemmanager. 2024-04-17T14:37:28.184 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T14:37:28.226 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:37:28.966 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager. 2024-04-17T14:37:28.983 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T14:37:29.032 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T14:37:29.640 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ppp. 2024-04-17T14:37:29.656 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T14:37:30.003 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T14:37:30.328 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T14:37:30.344 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T14:37:30.387 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T14:37:30.640 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T14:37:30.655 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T14:37:30.689 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T14:37:30.993 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T14:37:31.009 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T14:37:31.050 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T14:37:31.389 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T14:37:31.405 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:31.446 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:32.018 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T14:37:32.035 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T14:37:32.095 INFO:teuthology.orchestra.run.smithi016.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T14:37:32.117 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-common (238) ... 2024-04-17T14:37:32.533 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T14:37:32.549 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T14:37:32.594 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:33.737 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql. 2024-04-17T14:37:33.753 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T14:37:33.795 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql (14+238) ... 2024-04-17T14:37:34.031 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T14:37:34.046 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T14:37:34.080 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T14:37:34.324 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T14:37:34.340 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T14:37:34.374 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T14:37:34.769 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T14:37:34.786 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T14:37:34.827 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T14:37:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl. 2024-04-17T14:37:35.131 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T14:37:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T14:37:35.541 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T14:37:35.557 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T14:37:35.599 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T14:37:35.979 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T14:37:35.996 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T14:37:36.037 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T14:37:36.415 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T14:37:36.432 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T14:37:36.482 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T14:37:36.769 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T14:37:36.946 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T14:37:37.094 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T14:37:37.223 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:37.357 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T14:37:37.483 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T14:37:37.609 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:38.576 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T14:37:38.682 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T14:37:39.068 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T14:37:39.068 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T14:37:39.785 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T14:37:40.287 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T14:37:40.396 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T14:37:40.522 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T14:37:40.681 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T14:37:40.807 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T14:37:40.950 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T14:37:41.144 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T14:37:42.358 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T14:37:42.586 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T14:37:42.699 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T14:37:42.771 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:37:42.889 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T14:37:43.040 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T14:37:43.166 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T14:37:43.300 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T14:37:43.399 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T14:37:43.460 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T14:37:43.586 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T14:37:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T14:37:43.889 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:37:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T14:37:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T14:37:44.334 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T14:37:44.942 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:44.942 INFO:teuthology.orchestra.run.smithi016.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T14:37:44.943 INFO:teuthology.orchestra.run.smithi016.stdout:which means they are currently configured by ifupdown: 2024-04-17T14:37:44.943 INFO:teuthology.orchestra.run.smithi016.stdout:- ens1f0 2024-04-17T14:37:44.943 INFO:teuthology.orchestra.run.smithi016.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T14:37:44.943 INFO:teuthology.orchestra.run.smithi016.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T14:37:44.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:45.081 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T14:37:45.500 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T14:37:45.910 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T14:37:46.621 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T14:37:46.763 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T14:37:46.873 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T14:37:46.999 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-common (238) ... 2024-04-17T14:37:48.012 INFO:teuthology.orchestra.run.smithi016.stdout:Adding user postgres to group ssl-cert 2024-04-17T14:37:48.261 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:48.261 INFO:teuthology.orchestra.run.smithi016.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T14:37:48.545 INFO:teuthology.orchestra.run.smithi016.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T14:37:48.545 INFO:teuthology.orchestra.run.smithi016.stdout:Removing obsolete dictionary files: 2024-04-17T14:37:49.267 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T14:37:49.751 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T14:37:50.091 INFO:teuthology.orchestra.run.smithi016.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T14:37:50.126 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:This user must also own the server process. 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:The default text search configuration will be set to "english". 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:Data page checksums are disabled. 2024-04-17T14:37:50.184 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:37:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T14:37:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:creating subdirectories ... ok 2024-04-17T14:37:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T14:37:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default max_connections ... 100 2024-04-17T14:37:50.245 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default shared_buffers ... 128MB 2024-04-17T14:37:50.259 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default time zone ... Etc/UTC 2024-04-17T14:37:50.260 INFO:teuthology.orchestra.run.smithi016.stdout:creating configuration files ... ok 2024-04-17T14:37:50.434 INFO:teuthology.orchestra.run.smithi016.stdout:running bootstrap script ... ok 2024-04-17T14:37:51.072 INFO:teuthology.orchestra.run.smithi016.stdout:performing post-bootstrap initialization ... ok 2024-04-17T14:37:51.700 INFO:teuthology.orchestra.run.smithi016.stdout:syncing data to disk ... ok 2024-04-17T14:37:52.233 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T14:37:55.309 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:37:55.418 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T14:37:55.519 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql (14+238) ... 2024-04-17T14:37:55.620 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T14:37:55.755 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T14:37:56.026 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T14:37:56.026 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T14:37:56.840 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T14:37:56.941 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T14:37:57.284 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T14:37:57.462 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T14:37:58.538 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T14:37:58.671 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T14:37:59.225 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T14:37:59.233 DEBUG:teuthology.parallel:result is None 2024-04-17T14:37:59.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:37:59.389 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-04-17T14:37:59.411 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:37:59.412 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:37:59.412 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133-ga8c84f59-1jammy is installed. 2024-04-17T14:37:59.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:37:59.551 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2024-04-17T14:37:59.571 INFO:teuthology.orchestra.run.smithi067.stdout:19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:37:59.571 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T14:37:59.571 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133-ga8c84f59-1jammy is installed. 2024-04-17T14:37:59.572 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T14:37:59.572 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:37:59.572 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T14:37:59.592 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:37:59.592 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T14:37:59.628 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T14:37:59.628 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:37:59.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T14:37:59.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T14:37:59.719 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:37:59.719 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T14:37:59.733 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T14:37:59.788 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T14:37:59.788 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:37:59.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T14:37:59.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T14:37:59.866 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:37:59.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T14:37:59.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T14:37:59.936 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T14:37:59.936 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:37:59.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T14:37:59.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T14:38:00.019 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:00.019 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T14:38:00.033 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T14:38:00.092 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T14:38:00.165 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T14:38:00.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-17T14:38:00.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-04-17T14:38:00.185 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T14:38:00.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T14:38:00.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T14:38:00.247 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T14:38:00.247 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T14:38:00.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T14:38:00.313 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T14:38:00.313 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T14:38:00.313 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T14:38:00.313 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:00.313 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T14:38:00.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T14:38:00.446 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:00.446 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T14:38:00.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T14:38:00.533 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T14:38:00.533 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T14:38:00.534 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270', 'branch': 'wip-rishabh-testing-20240416.193735', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7660270', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240416.193735'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240416.193735', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3521, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'sleep_before_teardown': 0, 'subset': '410/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240416.193735', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCguLNMjncNpz3o8bS4UCM/sfrcef8c9AeqG0eeeU/AC/EJGgI4itrWpW0/vBSK0A5pdATltOpCH1kaC3XBgJ/A=', 'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtWG/r9XJQPeirGxJkjuzuMQpohPhCmGWLUGaEICj/xQl6TXT4bI8S9NLapM9mz/Bag3vdgJrTvwIgO2v+1CXk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_11:26:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T14:38:00.534 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T14:38:00.537 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T14:38:00.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T14:38:00.587 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T14:38:00.632 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:00.632 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T14:38:00.652 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T14:38:00.652 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-17 14:22:12.469272964 +0000 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-17 14:22:12.189275460 +0000 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-17 14:22:12.189275460 +0000 2024-04-17T14:38:00.701 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-17 14:22:12.189275460 +0000 2024-04-17T14:38:00.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T14:38:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-17T14:38:00.762 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-17T14:38:00.762 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.0002328 s, 2.2 MB/s 2024-04-17T14:38:00.763 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T14:38:00.818 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-17T14:38:00.868 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-17 14:22:13.061267682 +0000 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-17 14:22:12.769270287 +0000 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-17 14:22:12.769270287 +0000 2024-04-17T14:38:00.869 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-17 14:22:12.769270287 +0000 2024-04-17T14:38:00.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T14:38:00.929 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-17T14:38:00.929 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-17T14:38:00.930 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000225104 s, 2.3 MB/s 2024-04-17T14:38:00.931 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T14:38:00.982 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-17 14:22:13.633262579 +0000 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-17 14:22:13.373264898 +0000 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-17 14:22:13.373264898 +0000 2024-04-17T14:38:01.033 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-17 14:22:13.373264898 +0000 2024-04-17T14:38:01.033 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T14:38:01.093 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-17T14:38:01.094 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-17T14:38:01.094 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000230435 s, 2.2 MB/s 2024-04-17T14:38:01.096 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T14:38:01.146 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 955 Links: 1 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-17 14:22:14.189257618 +0000 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-17 14:22:13.913260081 +0000 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-17 14:22:13.913260081 +0000 2024-04-17T14:38:01.197 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-17 14:22:13.913260081 +0000 2024-04-17T14:38:01.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T14:38:01.258 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-17T14:38:01.258 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-17T14:38:01.258 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000227066 s, 2.3 MB/s 2024-04-17T14:38:01.260 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T14:38:01.310 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:01.310 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:01.311 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T14:38:01.317 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T14:38:01.317 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-17 14:21:54.406385086 +0000 2024-04-17T14:38:01.365 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-17 14:21:54.142387444 +0000 2024-04-17T14:38:01.366 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-17 14:21:54.142387444 +0000 2024-04-17T14:38:01.366 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-04-17T14:38:01.366 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T14:38:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-17T14:38:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-17T14:38:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000507463 s, 1.0 MB/s 2024-04-17T14:38:01.420 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T14:38:01.469 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-04-17T14:38:01.520 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T14:38:01.520 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.520 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-17T14:38:01.521 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.521 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-17 14:21:54.918380512 +0000 2024-04-17T14:38:01.521 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-17 14:21:54.658382835 +0000 2024-04-17T14:38:01.521 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-17 14:21:54.658382835 +0000 2024-04-17T14:38:01.521 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-04-17T14:38:01.521 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T14:38:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-17T14:38:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-17T14:38:01.575 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000574007 s, 892 kB/s 2024-04-17T14:38:01.576 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T14:38:01.626 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-17 14:21:55.430375939 +0000 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-17 14:21:55.146378475 +0000 2024-04-17T14:38:01.673 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-17 14:21:55.146378475 +0000 2024-04-17T14:38:01.674 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-04-17T14:38:01.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T14:38:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-17T14:38:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-17T14:38:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000506388 s, 1.0 MB/s 2024-04-17T14:38:01.729 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T14:38:01.777 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-04-17T14:38:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-17 14:21:55.946371329 +0000 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-17 14:21:55.670373794 +0000 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-17 14:21:55.670373794 +0000 2024-04-17T14:38:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-04-17T14:38:01.825 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T14:38:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-17T14:38:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-17T14:38:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000471696 s, 1.1 MB/s 2024-04-17T14:38:01.880 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T14:38:01.930 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:01.931 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T14:38:01.931 INFO:tasks.ceph:Generating config... 2024-04-17T14:38:01.932 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-17T14:38:01.932 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T14:38:01.932 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T14:38:01.932 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-17T14:38:01.933 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-17T14:38:01.933 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-17T14:38:01.933 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-17T14:38:01.933 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-17T14:38:01.933 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-17T14:38:01.933 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-17T14:38:01.933 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-17T14:38:01.933 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-17T14:38:01.933 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-17T14:38:01.933 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T14:38:01.934 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-17T14:38:01.935 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-17T14:38:01.935 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-17T14:38:01.935 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-17T14:38:01.935 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-17T14:38:01.935 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T14:38:01.936 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-17T14:38:01.937 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T14:38:01.937 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-17T14:38:01.937 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T14:38:01.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T14:38:01.984 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T14:38:01.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T14:38:02.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T14:38:02.107 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]')] 2024-04-17T14:38:02.107 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-17T14:38:02.108 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:02.109 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T14:38:02.161 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:02.253 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid a4da2728-df57-41cc-8313-34e85a419083 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:fsid a4da2728-df57-41cc-8313-34e85a419083 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-17T14:38:02.256792+0000 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-17T14:38:02.256792+0000 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-17T14:38:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-17T14:38:02.255 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-17T14:38:02.255 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-04-17T14:38:02.255 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-04-17T14:38:02.255 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T14:38:02.257 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T14:38:02.266 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a4da2728-df57-41cc-8313-34e85a419083... 2024-04-17T14:38:02.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T14:38:02.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.346 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-04-17T14:38:02.347 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-04-17T14:38:02.348 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-04-17T14:38:02.349 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.16,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mds beacon grace = 60 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: mds heartbeat grace = 60 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2024-04-17T14:38:02.350 INFO:teuthology.orchestra.run.smithi067.stdout: osd heartbeat grace = 60 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = a4da2728-df57-41cc-8313-34e85a419083 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.351 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.352 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-04-17T14:38:02.353 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-04-17T14:38:02.354 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: osd fast shutdown = False 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.355 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-04-17T14:38:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-17T14:38:02.357 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-04-17T14:38:02.358 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd crush smoke test = False 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T14:38:02.359 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-17T14:38:02.360 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.e] 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.f] 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: mds valgrind exit = True 2024-04-17T14:38:02.361 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-04-17T14:38:02.362 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-17T14:38:02.362 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-17T14:38:02.362 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-17T14:38:02.362 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-17T14:38:02.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.364 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.365 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mds beacon grace = 60 2024-04-17T14:38:02.366 INFO:teuthology.orchestra.run.smithi016.stdout: mds heartbeat grace = 60 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: osd heartbeat grace = 60 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = a4da2728-df57-41cc-8313-34e85a419083 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-17T14:38:02.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.368 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-04-17T14:38:02.369 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-17T14:38:02.370 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: osd fast shutdown = False 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-17T14:38:02.371 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-17T14:38:02.372 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.373 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd crush smoke test = False 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T14:38:02.374 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-17T14:38:02.375 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: mds valgrind exit = True 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-17T14:38:02.376 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-17T14:38:02.377 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-17T14:38:02.378 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T14:38:02.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T14:38:02.483 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T14:38:02.483 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:02.483 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T14:38:02.492 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:02.492 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T14:38:02.541 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:38:02.541 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:02.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T14:38:02.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T14:38:02.616 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:02.616 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:02.670 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:38:02.671 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:02.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T14:38:02.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T14:38:02.694 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:02.695 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:02.745 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T14:38:02.745 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T14:38:02.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T14:38:02.802 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T14:38:02.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T14:38:02.854 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T14:38:02.936 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T14:38:02.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T14:38:02.993 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T14:38:02.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T14:38:03.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T14:38:03.119 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T14:38:03.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-17T14:38:03.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-17T14:38:03.239 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-17T14:38:03.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-17T14:38:03.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T14:38:03.309 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T14:38:03.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T14:38:03.325 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T14:38:03.407 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T14:38:03.410 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-17T14:38:03.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-17T14:38:03.547 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-17T14:38:03.550 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-17T14:38:03.603 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T14:38:03.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T14:38:03.648 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T14:38:03.665 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T14:38:03.665 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T14:38:03.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T14:38:03.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:03.727 INFO:tasks.ceph:role: osd.0 2024-04-17T14:38:03.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:38:03.728 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:03.792 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:03.816 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-17T14:38:03.819 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-17T14:38:03.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T14:38:03.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T14:38:03.952 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:03.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:03.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T14:38:04.015 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:04.015 INFO:tasks.ceph:role: osd.1 2024-04-17T14:38:04.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:38:04.016 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T14:38:04.075 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:04.076 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:04.100 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-17T14:38:04.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-17T14:38:04.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T14:38:04.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T14:38:04.236 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:04.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:04.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T14:38:04.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:04.304 INFO:tasks.ceph:role: osd.2 2024-04-17T14:38:04.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:38:04.304 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T14:38:04.363 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:04.363 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:04.364 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:04.388 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-17T14:38:04.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-17T14:38:04.391 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T14:38:04.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T14:38:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:04.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:04.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T14:38:04.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:04.584 INFO:tasks.ceph:role: osd.3 2024-04-17T14:38:04.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T14:38:04.584 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T14:38:04.643 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:04.643 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:04.643 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:04.643 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:04.644 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:04.667 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-17T14:38:04.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-17T14:38:04.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T14:38:04.737 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T14:38:04.800 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:04.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:04.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.929+0000 7f3ce24957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T14:38:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.929+0000 7f3ce24957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T14:38:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.929+0000 7f3ce24957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T14:38:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.929+0000 7f3ce24957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T14:38:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.929+0000 7f3ce24957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T14:38:04.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:04.933+0000 7f3ce24957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T14:38:07.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T14:38:08.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T14:38:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T14:38:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T14:38:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T14:38:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T14:38:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:08.101+0000 7f172ed5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T14:38:11.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T14:38:11.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:11.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T14:38:11.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T14:38:11.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T14:38:11.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T14:38:11.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T14:38:11.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:11.265+0000 7f9b485a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T14:38:14.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T14:38:14.327 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.421+0000 7f1536da17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T14:38:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.425+0000 7f1536da17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T14:38:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.425+0000 7f1536da17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T14:38:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.425+0000 7f1536da17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T14:38:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.425+0000 7f1536da17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T14:38:14.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:14.425+0000 7f1536da17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T14:38:17.483 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T14:38:17.504 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T14:38:17.519 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:17.519 INFO:tasks.ceph:role: osd.4 2024-04-17T14:38:17.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:38:17.520 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T14:38:17.587 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:17.587 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:17.587 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:17.587 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:17.587 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:17.588 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:17.588 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:17.588 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:17.588 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:17.588 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:18.045 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-17T14:38:18.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-17T14:38:18.047 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T14:38:18.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T14:38:18.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:18.156 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:18.157 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T14:38:18.212 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:18.213 INFO:tasks.ceph:role: osd.5 2024-04-17T14:38:18.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:38:18.213 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T14:38:18.276 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:18.276 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:18.276 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:18.277 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:18.761 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-17T14:38:18.763 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-17T14:38:18.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T14:38:18.890 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T14:38:18.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:18.903 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:18.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T14:38:18.959 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:18.959 INFO:tasks.ceph:role: osd.6 2024-04-17T14:38:18.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:38:18.959 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:19.024 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:19.502 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-17T14:38:19.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-17T14:38:19.504 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T14:38:19.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T14:38:19.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:19.681 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T14:38:19.736 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T14:38:19.736 INFO:tasks.ceph:role: osd.7 2024-04-17T14:38:19.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T14:38:19.737 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T14:38:19.801 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T14:38:19.801 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T14:38:19.802 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T14:38:20.233 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-17T14:38:20.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-17T14:38:20.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T14:38:20.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T14:38:20.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:38:20.373 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T14:38:20.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:20.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.492+0000 7f6f516027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T14:38:20.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.492+0000 7f6f516027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T14:38:20.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.492+0000 7f6f516027c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T14:38:20.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.492+0000 7f6f516027c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T14:38:20.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.492+0000 7f6f516027c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T14:38:20.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:20.496+0000 7f6f516027c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T14:38:23.473 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T14:38:23.488 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:23.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T14:38:23.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T14:38:23.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T14:38:23.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T14:38:23.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T14:38:23.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:23.580+0000 7f22e5a967c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T14:38:26.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T14:38:26.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.700+0000 7f0b33b887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T14:38:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.704+0000 7f0b33b887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T14:38:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.704+0000 7f0b33b887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T14:38:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.704+0000 7f0b33b887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T14:38:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.704+0000 7f0b33b887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T14:38:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:26.704+0000 7f0b33b887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T14:38:29.679 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T14:38:29.736 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:29.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T14:38:29.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T14:38:29.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T14:38:29.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T14:38:29.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T14:38:29.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:38:29.824+0000 7fc73fffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T14:38:30.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:38:30.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:38:32.786 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T14:38:32.800 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T14:38:32.800 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:32.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T14:38:32.823 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:32.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T14:38:32.885 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:32.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-17T14:38:32.949 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:32.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-17T14:38:33.013 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:33.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T14:38:33.077 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:33.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T14:38:33.141 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:33.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T14:38:33.205 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:33.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T14:38:33.269 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T14:38:33.284 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T14:38:33.339 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-17T14:38:33.395 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-17T14:38:33.451 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T14:38:33.507 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.507 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T14:38:33.563 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.563 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T14:38:33.619 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:38:33.619 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T14:38:33.675 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:38:33.675 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T14:38:33.684 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T14:38:33.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T14:38:33.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDK3h9mNF0GMBAAOdBytzFBd1NL5w0fbuMjVg== 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDK3h9m3VBlOxAA+BNnUwEBsaBxhj/pwy5J+w== 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9mcA1LBxAAq8Aemdt4SFTWzylgxyPY2w== 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.e] 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9mAid9DhAAYAMIxFidz5Lu9IcazlfBDA== 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDM3h9mtb+mNxAA5wv1gd9S6iHqu9HdZnaSBg== 2024-04-17T14:38:33.739 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDQ3h9mEDw9BhAAy0p1IgT/qazCGoN2DS2Ykw== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDT3h9mmxkMEBAA4cDqcpmTTUOO162gBGzpLQ== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDW3h9m/JaCGRAADJ3WzYXL99Sc+MfLKm0tVA== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDK3h9mdjJBMxAAbCsw4k2X0sqDWeRPdxS5yg== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9mq6/SEhAAxJV9gJbRh3PcLdSZo8MhMw== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9mLIGjGBAAs6XgncudiGoiJniaNV4J6Q== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.f] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9mwA74IBAAV0MtwD4+EPzATpHqIpqY2w== 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-04-17T14:38:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDc3h9m3UhvHRAAkq7JBYXjzMPA6P2IQQ43Ig== 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDf3h9mfuCuIhAAdpLu1V8mYPGuwTeyD5oqvg== 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDi3h9m+4cLKhAAkcAvhUJ/q2cR42ZtrBzzvw== 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDl3h9mYaA/MRAALkxFsfOghZXbt/7zCs8q1Q== 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-04-17T14:38:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDL3h9m5XPUJhAADI68bK6l3lDZIeY3YQifCg== 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDK3h9mNF0GMBAAOdBytzFBd1NL5w0fbuMjVg== 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDK3h9m3VBlOxAA+BNnUwEBsaBxhj/pwy5J+w== 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9mcA1LBxAAq8Aemdt4SFTWzylgxyPY2w== 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-17T14:38:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9mAid9DhAAYAMIxFidz5Lu9IcazlfBDA== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDM3h9mtb+mNxAA5wv1gd9S6iHqu9HdZnaSBg== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDQ3h9mEDw9BhAAy0p1IgT/qazCGoN2DS2Ykw== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDT3h9mmxkMEBAA4cDqcpmTTUOO162gBGzpLQ== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDW3h9m/JaCGRAADJ3WzYXL99Sc+MfLKm0tVA== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDK3h9mdjJBMxAAbCsw4k2X0sqDWeRPdxS5yg== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9mq6/SEhAAxJV9gJbRh3PcLdSZo8MhMw== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9mLIGjGBAAs6XgncudiGoiJniaNV4J6Q== 2024-04-17T14:38:33.744 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9mwA74IBAAV0MtwD4+EPzATpHqIpqY2w== 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDc3h9m3UhvHRAAkq7JBYXjzMPA6P2IQQ43Ig== 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDf3h9mfuCuIhAAdpLu1V8mYPGuwTeyD5oqvg== 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDi3h9m+4cLKhAAkcAvhUJ/q2cR42ZtrBzzvw== 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDl3h9mYaA/MRAALkxFsfOghZXbt/7zCs8q1Q== 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-17T14:38:33.745 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDL3h9m5XPUJhAADI68bK6l3lDZIeY3YQifCg== 2024-04-17T14:38:33.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T14:38:33.791 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T14:38:33.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:33.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:33.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:33.912 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:33.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:33.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.180 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T14:38:34.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T14:38:34.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.490 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T14:38:34.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.626 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.715 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T14:38:34.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T14:38:34.933 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T14:38:34.987 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T14:38:34.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T14:38:35.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T14:38:35.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T14:38:35.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T14:38:35.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T14:38:35.247 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T14:38:35.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T14:38:35.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T14:38:35.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T14:38:35.413 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:35.416 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T14:38:35.458 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T14:38:35.459 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-17T14:38:35.459 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T14:38:35.459 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-17T14:38:35.471 INFO:tasks.ceph.mon.a:Started 2024-04-17T14:38:35.471 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-17T14:38:35.471 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T14:38:35.471 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-17T14:38:35.504 INFO:tasks.ceph.mon.b:Started 2024-04-17T14:38:35.504 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-17T14:38:35.504 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T14:38:35.504 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-17T14:38:35.507 INFO:tasks.ceph.mon.c:Started 2024-04-17T14:38:35.507 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T14:38:35.507 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T14:38:35.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-17T14:38:35.511 INFO:tasks.ceph.mgr.y:Started 2024-04-17T14:38:35.511 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T14:38:35.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-17T14:38:35.513 INFO:tasks.ceph.mgr.x:Started 2024-04-17T14:38:35.514 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T14:38:35.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T14:38:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 Processor -- start 2024-04-17T14:38:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 -- start start 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d006e400 con 0x7f20d0152ec0 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20d006e1d0 con 0x7f20d00ca2b0 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20d5200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20d00c5420 2024-04-17T14:38:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20d00c34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 msgr2=0x7f20d015c130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20ce800640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 msgr2=0x7f20d0159690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.652+0000 7f20ce800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:35.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.856+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20d00c34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:35.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.856+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 msgr2=0x7f20d015c130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:35.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.856+0000 7f20ce800640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 msgr2=0x7f20d0159690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:35.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.856+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:35.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:35.856+0000 7f20ce800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:36.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:36.260+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20d00c34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:36.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:36.260+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 msgr2=0x7f20d015c130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:36.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:36.260+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:36.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:36.260+0000 7f20ce800640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 msgr2=0x7f20d0159690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:36.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:36.260+0000 7f20ce800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:37.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:37.064+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20d00c34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:37.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:37.064+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 msgr2=0x7f20d015c130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:37.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:37.064+0000 7f20ce800640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 msgr2=0x7f20d0159690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:37.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:37.064+0000 7f20ce800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:37.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:37.064+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 msgr2=0x7f20d015c130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20d00c5420 0x7f20d015c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 msgr2=0x7f20d0159690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20d00ca2b0 0x7f20d0159690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20d00c34c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00c8ea0 con 0x7f20ac006230 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0036d0 2024-04-17T14:38:38.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20cde00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:38.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20c7e00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac006230 legacy=0x7f20ac0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:38.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.652+0000 7f20cde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:38.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.856+0000 7f20cde00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:38.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.856+0000 7f20cde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:38.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:38.856+0000 7f20c7e00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac006230 legacy=0x7f20ac0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:39.260+0000 7f20cde00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:39.260+0000 7f20cde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:39.260+0000 7f20c7e00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac006230 legacy=0x7f20ac0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:40.064+0000 7f20cde00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:40.064+0000 7f20cde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:40.064+0000 7f20c7e00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac006230 legacy=0x7f20ac0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac0036d0 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac006230 legacy=0x7f20ac0086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20ce800640 1 -- reap_dead start 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:41.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d006e400 con 0x7f20d0152ec0 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00c8ea0 con 0x7f20ac00aaa0 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac00a680 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20ce800640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac00aaa0 legacy=0x7f20ac008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:41.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.652+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:41.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.856+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:41.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.856+0000 7f20ce800640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac00aaa0 legacy=0x7f20ac008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:41.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.856+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:41.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:41.856+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:42.260+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:42.260+0000 7f20ce800640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac00aaa0 legacy=0x7f20ac008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:42.260+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:42.260+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:43.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:43.064+0000 7f20cde00640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.16:6789/0 2024-04-17T14:38:43.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:43.064+0000 7f20ce800640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac00aaa0 legacy=0x7f20ac008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-04-17T14:38:43.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:43.064+0000 7f20c7e00640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3301/0 2024-04-17T14:38:43.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:43.064+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:44.323 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:00:08.690 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.468 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:00:08.788 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.489 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:00:08.797 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.652+0000 7f20c7400640 1 -- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:44.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.652+0000 7f20c7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac00a680 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:44.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.652+0000 7f20c7400640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f20ac00aaa0 legacy=0x7f20ac008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.652+0000 7f20c7400640 1 -- >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.652+0000 7f20c7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20c7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20c7400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac011130 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20c7400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac013b90 con 0x7f20ac009340 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20c7e00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20cde00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 msgr2=0x7f20ac009750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:44.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.656+0000 7f20cde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:44.678 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:00:09.045 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.819 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:00:09.138 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.837 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:00:09.145 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:38:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.860+0000 7f20c7e00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.860+0000 7f20c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.860+0000 7f20cde00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 msgr2=0x7f20ac009750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:44.860+0000 7f20cde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:45.264+0000 7f20c7e00640 1 -- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.16:3300/0 2024-04-17T14:38:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:45.264+0000 7f20c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:45.264+0000 7f20cde00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 msgr2=0x7f20ac009750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:45.264+0000 7f20cde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.068+0000 7f20cde00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 msgr2=0x7f20ac009750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-04-17T14:38:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.068+0000 7f20cde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.272+0000 7f20c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:46.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.412+0000 7f20c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55306/0 (socket says 172.21.15.16:55306) 2024-04-17T14:38:46.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.412+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 learned_addr learned my addr 172.21.15.16:0/2254917157 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:38:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.464+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.464+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.464+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:46.464+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 msgr2=0x7f20ac009750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac009340 0x7f20ac009750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac011130 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 reap_dead start 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac009010 con 0x7f20d0152ec0 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0097c0 2024-04-17T14:38:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac013b90 con 0x7f20ac009340 2024-04-17T14:38:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.672+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:47.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.676+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:47.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.676+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:47.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.676+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:47.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.676+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:47.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.800+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:47.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.808+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T14:38:47.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.808+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:47.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.808+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:47.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.808+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.880+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.884+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.884+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.884+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:47.884+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:48.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.180+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:48.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.288+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:48.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.288+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T14:38:48.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.288+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.288+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.288+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.292+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.292+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.292+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:48.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.292+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:48.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.696+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.700+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.700+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.700+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:48.700+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:49.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.092+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:49.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.096+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:49.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.096+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:49.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.096+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:49.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.096+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:49.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.504+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.508+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.508+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.508+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:49.508+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 msgr2=0x7f20ac005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac009340 0x7f20ac005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d006e400 con 0x7f20ac00e6b0 2024-04-17T14:38:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0067c0 2024-04-17T14:38:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.656+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:50.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.860+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:50.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.860+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:50.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.860+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:50.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.860+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:50.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:50.860+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:51.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:51.264+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:51.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:51.264+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:51.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:51.264+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:51.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:51.264+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:51.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:51.264+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:52.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:52.068+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:52.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:52.068+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:52.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:52.068+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:52.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:52.068+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:52.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:52.068+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v1:172.21.15.67:6789/0 conn(0x7f20ac00e6b0 legacy=0x7f20ac013d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 reap_dead start 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00c8ea0 con 0x7f20d0152ec0 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac010d80 con 0x7f20ac00e6b0 2024-04-17T14:38:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0097c0 2024-04-17T14:38:53.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.660+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.676+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.676+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.676+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.676+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:53.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.880+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:53.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.888+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:53.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.888+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:53.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.888+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:53.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:53.888+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:54.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:54.292+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:54.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:54.296+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:54.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:54.296+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:54.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:54.296+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:54.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:54.296+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:55.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:55.100+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:55.104+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:55.104+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:55.104+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:55.104+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac013520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac013520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v1:172.21.15.67:6789/0 conn(0x7f20ac00e6b0 legacy=0x7f20ac013d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:56.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0067c0 2024-04-17T14:38:56.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac013b90 con 0x7f20ac003b00 2024-04-17T14:38:56.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:56.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.656+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:56.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:56.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.660+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:56.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:56.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:56.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T14:38:56.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:56.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:56.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.864+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:56.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.868+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:56.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.868+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:56.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.868+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:56.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:56.868+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:57.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.268+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:57.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.268+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:57.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.268+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:57.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.268+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:57.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.268+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.272+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.276+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.276+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.276+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:57.276+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:38:58.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.072+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.072+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.072+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.072+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.072+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:58.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.080+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:58.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.080+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:58.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.080+0000 7f20c7e00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:58.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.080+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:58.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:58.084+0000 7f20c7e00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T14:38:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac003b00 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 msgr2=0x7f20ac00e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.16:3300/0 conn(0x7f20ac0067c0 0x7f20ac00e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 reap_dead start 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac009510 con 0x7f20d0152ec0 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20d01532a0 con 0x7f20ac0097c0 2024-04-17T14:38:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20c7400640 1 -- 172.21.15.16:0/2254917157 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac013b90 con 0x7f20ac015ab0 2024-04-17T14:38:59.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.656+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:59.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.660+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:59.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.660+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:59.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.660+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:59.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.660+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:59.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.696+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:59.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.700+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T14:38:59.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.700+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:59.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.700+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:59.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.700+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T14:38:59.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.864+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.868+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.868+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.868+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.868+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:38:59.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.904+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:38:59.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.908+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:38:59.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.908+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:38:59.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.908+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:38:59.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:38:59.908+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T14:39:00.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.272+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:00.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.272+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:39:00.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.272+0000 7f20cde00640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:39:00.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.272+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:39:00.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.272+0000 7f20cde00640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:39:00.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.372+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:00.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.384+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T14:39:00.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.384+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T14:39:00.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.384+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T14:39:00.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.384+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T14:39:00.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:39:00.614 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:39:00.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.744+0000 7f20cd400640 1 -- 172.21.15.16:0/2254917157 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132873421 0 0) 0x7f20ac009510 con 0x7f20d0152ec0 2024-04-17T14:39:00.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:00.744+0000 7f20cd400640 1 -- 172.21.15.16:0/2254917157 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20b4003530 con 0x7f20d0152ec0 2024-04-17T14:39:01.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.188+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> v2:172.21.15.67:3300/0 conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:01.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.260+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 msgr2=0x7f20ac017ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:01.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.260+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.260+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 >> v1:172.21.15.16:6789/0 conn(0x7f20d0152ec0 legacy=0x7f20ac009f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:01.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.260+0000 7f20ce800640 1 -- 172.21.15.16:0/2254917157 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac00e6b0 con 0x7f20ac0097c0 2024-04-17T14:39:01.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.364+0000 7f20ce800640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20ac0097c0 0x7f20ac015430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20d0156730 tx=0x7f20c801e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642148f1f9f6668 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:01.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20cd400640 1 -- 172.21.15.16:0/2254917157 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c80b4070 con 0x7f20ac0097c0 2024-04-17T14:39:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20cd400640 1 -- 172.21.15.16:0/2254917157 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c80af410 con 0x7f20ac0097c0 2024-04-17T14:39:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20cd400640 1 -- 172.21.15.16:0/2254917157 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c80af620 con 0x7f20ac0097c0 2024-04-17T14:39:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20ac0097c0 msgr2=0x7f20ac015430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20ac0097c0 0x7f20ac015430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20d0156730 tx=0x7f20c801e0e0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- 172.21.15.16:0/2254917157 shutdown_connections 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20ac0097c0 0x7f20ac015430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- 172.21.15.16:0/2254917157 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac015ab0 0x7f20ac017ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- 172.21.15.16:0/2254917157 >> 172.21.15.16:0/2254917157 conn(0x7f20d0062850 msgr2=0x7f20d006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- 172.21.15.16:0/2254917157 shutdown_connections 2024-04-17T14:39:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- 172.21.15.16:0/2254917157 wait complete. 2024-04-17T14:39:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 Processor -- start 2024-04-17T14:39:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- start start 2024-04-17T14:39:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac0097c0 0x7f20d00c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20d0152ec0 0x7f20d014c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20d0158e90 con 0x7f20ac015ab0 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00c9440 con 0x7f20d0152ec0 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.480+0000 7f20d5200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20d0159170 con 0x7f20ac0097c0 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.484+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.484+0000 7f20c7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46806/0 (socket says 172.21.15.16:46806) 2024-04-17T14:39:01.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.484+0000 7f20c7e00640 1 -- 172.21.15.16:0/1441557162 learned_addr learned my addr 172.21.15.16:0/1441557162 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:01.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 -- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac0097c0 msgr2=0x7f20d00c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:01.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac0097c0 0x7f20d00c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 -- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20d0152ec0 msgr2=0x7f20d014c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:01.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20d0152ec0 0x7f20d014c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:01.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 -- 172.21.15.16:0/1441557162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d006bd40 con 0x7f20ac015ab0 2024-04-17T14:39:01.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.488+0000 7f20c7e00640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20b8003ad0 tx=0x7f20b8015e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:01.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.492+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8027070 con 0x7f20ac015ab0 2024-04-17T14:39:01.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.492+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b8003d30 con 0x7f20ac015ab0 2024-04-17T14:39:01.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.492+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8014bd0 con 0x7f20ac015ab0 2024-04-17T14:39:01.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.492+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d00cf260 con 0x7f20ac015ab0 2024-04-17T14:39:01.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.492+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d006d1f0 con 0x7f20ac015ab0 2024-04-17T14:39:01.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.496+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d0076280 con 0x7f20ac015ab0 2024-04-17T14:39:01.575 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:01.572+0000 7fd3b181a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T14:39:01.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.672+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20b802a070 con 0x7f20ac015ab0 2024-04-17T14:39:01.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.672+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f20b802c780 con 0x7f20ac015ab0 2024-04-17T14:39:01.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.672+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f20b8032080 con 0x7f20ac015ab0 2024-04-17T14:39:01.768 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:01.771+0000 7f7e1eccf180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T14:39:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:01.800+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f20d0156d30 con 0x7f20ac015ab0 2024-04-17T14:39:02.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.092+0000 7f20c6000640 1 -- 172.21.15.16:0/1441557162 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f20b801d050 con 0x7f20ac015ab0 2024-04-17T14:39:02.096 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 msgr2=0x7f20d00c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20b8003ad0 tx=0x7f20b8015e10 comp rx=0 tx=0).stop 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 shutdown_connections 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20d0152ec0 0x7f20d014c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac015ab0 0x7f20d00c8320 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 --2- 172.21.15.16:0/1441557162 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20ac0097c0 0x7f20d00c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 >> 172.21.15.16:0/1441557162 conn(0x7f20d0062850 msgr2=0x7f20d0158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 shutdown_connections 2024-04-17T14:39:02.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:02.096+0000 7f20d5200640 1 -- 172.21.15.16:0/1441557162 wait complete. 2024-04-17T14:39:02.126 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T14:39:02.126 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T14:39:02.127 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:39:02.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T14:39:02.147 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:39:02.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T14:39:02.169 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:02.164+0000 7fd3b181a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T14:39:02.188 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:39:02.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T14:39:02.249 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:39:02.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T14:39:02.260 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:02.263+0000 7f7e1eccf180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T14:39:02.312 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:39:02.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T14:39:02.325 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:39:02.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T14:39:02.377 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:39:02.378 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T14:39:02.407 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:02.404+0000 7fd3b181a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T14:39:02.429 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-17T14:39:02.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T14:39:02.460 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:02.463+0000 7f7e1eccf180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T14:39:02.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 5867be69-408d-4083-b813-50ab0974d3ff 0 2024-04-17T14:39:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 Processor -- start 2024-04-17T14:39:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 -- start start 2024-04-17T14:39:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f903c070050 0x7f903c0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c1580a0 con 0x7f903c0ca2f0 2024-04-17T14:39:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f903c0ccc10 con 0x7f903c070050 2024-04-17T14:39:02.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.639+0000 7f90439cb640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f903c06e280 con 0x7f903c06fc70 2024-04-17T14:39:02.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9041767640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:02.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9040f66640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f903c070050 0x7f903c0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:02.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9041f68640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f903c0ca2f0 0x7f903c150e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.67:47626/0 (socket says 172.21.15.67:47626) 2024-04-17T14:39:02.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9041f68640 1 -- 172.21.15.67:0/3779783420 learned_addr learned my addr 172.21.15.67:0/3779783420 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f903bfff640 1 -- 172.21.15.67:0/3779783420 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904342787 0 0) 0x7f902c001120 con 0x7f903c0ca2f0 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f903bfff640 1 -- 172.21.15.67:0/3779783420 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9024003530 con 0x7f903c0ca2f0 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9040f66640 1 -- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 msgr2=0x7f903c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9040f66640 1 --2- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9040f66640 1 -- 172.21.15.67:0/3779783420 >> v1:172.21.15.16:6789/0 conn(0x7f903c0ca2f0 legacy=0x7f903c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.643+0000 7f9040f66640 1 -- 172.21.15.67:0/3779783420 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c0cac00 con 0x7f903c070050 2024-04-17T14:39:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.651+0000 7f9040f66640 1 --2- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c070050 0x7f903c0cb100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90300097c0 tx=0x7f903001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1303588635715e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:02.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.651+0000 7f903bfff640 1 -- 172.21.15.67:0/3779783420 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90300a7070 con 0x7f903c070050 2024-04-17T14:39:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f903bfff640 1 -- 172.21.15.67:0/3779783420 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90300b0070 con 0x7f903c070050 2024-04-17T14:39:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f903bfff640 1 -- 172.21.15.67:0/3779783420 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90300ab870 con 0x7f903c070050 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 -- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c070050 msgr2=0x7f903c0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 --2- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c070050 0x7f903c0cb100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90300097c0 tx=0x7f903001c470 comp rx=0 tx=0).stop 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 -- 172.21.15.67:0/3779783420 shutdown_connections 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 --2- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c070050 0x7f903c0cb100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 --2- 172.21.15.67:0/3779783420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 -- 172.21.15.67:0/3779783420 >> 172.21.15.67:0/3779783420 conn(0x7f903c0cd400 msgr2=0x7f903c0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 -- 172.21.15.67:0/3779783420 shutdown_connections 2024-04-17T14:39:02.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.655+0000 7f90439cb640 1 -- 172.21.15.67:0/3779783420 wait complete. 2024-04-17T14:39:02.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 Processor -- start 2024-04-17T14:39:02.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 -- start start 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 0x7f903c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 0x7f903c0736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0cba50 con 0x7f903c070050 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f903c06ede0 con 0x7f903c0ca2f0 2024-04-17T14:39:02.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f90439cb640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f903c06df80 con 0x7f903c06fc70 2024-04-17T14:39:02.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f9041f68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 0x7f903c0736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:02.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f9041767640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:02.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f9040f66640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 0x7f903c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:02.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f9041767640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43206/0 (socket says 172.21.15.67:43206) 2024-04-17T14:39:02.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.659+0000 7f9041767640 1 -- 172.21.15.67:0/3880201114 learned_addr learned my addr 172.21.15.67:0/3880201114 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:02.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9041f68640 1 -- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 msgr2=0x7f903c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:02.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9041f68640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9041f68640 1 -- 172.21.15.67:0/3880201114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 msgr2=0x7f903c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:02.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9041f68640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 0x7f903c152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:02.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9041f68640 1 -- 172.21.15.67:0/3880201114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c1f78b0 con 0x7f903c0ca2f0 2024-04-17T14:39:02.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.663+0000 7f9040f66640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 0x7f903c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T14:39:02.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.667+0000 7f9041f68640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 0x7f903c0736e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c3c0 tx=0x7f902c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c017070 con 0x7f903c0ca2f0 2024-04-17T14:39:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c005db0 con 0x7f903c0ca2f0 2024-04-17T14:39:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c156a20 con 0x7f903c0ca2f0 2024-04-17T14:39:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c0072f0 con 0x7f903c0ca2f0 2024-04-17T14:39:02.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c1f7e30 con 0x7f903c0ca2f0 2024-04-17T14:39:02.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.671+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c076280 con 0x7f903c0ca2f0 2024-04-17T14:39:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.679+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f902c01a070 con 0x7f903c0ca2f0 2024-04-17T14:39:02.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.679+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f902c012740 con 0x7f903c0ca2f0 2024-04-17T14:39:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.867+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f902c021020 con 0x7f903c0ca2f0 2024-04-17T14:39:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:02.963+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5867be69-408d-4083-b813-50ab0974d3ff", "id": 0} v 0) -- 0x7f903c145180 con 0x7f903c0ca2f0 2024-04-17T14:39:03.063 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.067+0000 7f7e1eccf180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T14:39:03.100 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.096+0000 7fd3b181a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T14:39:03.122 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.123+0000 7f7e1eccf180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T14:39:03.181 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.183+0000 7f7e1eccf180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T14:39:03.183 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.180+0000 7fd3b181a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T14:39:03.247 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.244+0000 7fd3b181a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T14:39:03.267 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.271+0000 7f7e1eccf180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T14:39:03.324 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.327+0000 7f7e1eccf180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T14:39:03.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f9039ffb640 1 -- 172.21.15.67:0/3880201114 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5867be69-408d-4083-b813-50ab0974d3ff", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f903c1580a0 con 0x7f903c0ca2f0 2024-04-17T14:39:03.335 INFO:teuthology.orchestra.run.smithi067.stdout:0 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 msgr2=0x7f903c0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 0x7f903c0736e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c3c0 tx=0x7f902c00c880 comp rx=0 tx=0).stop 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 shutdown_connections 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f903c0ca2f0 0x7f903c0736e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c070050 0x7f903c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 --2- 172.21.15.67:0/3880201114 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f903c06fc70 0x7f903c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 >> 172.21.15.67:0/3880201114 conn(0x7f903c0cd400 msgr2=0x7f903c14d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 shutdown_connections 2024-04-17T14:39:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.339+0000 7f90439cb640 1 -- 172.21.15.67:0/3880201114 wait complete. 2024-04-17T14:39:03.341 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.340+0000 7fd3b181a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T14:39:03.355 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new f55759fe-4003-42e2-8361-397d42b91329 1 2024-04-17T14:39:03.404 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.400+0000 7fd3b181a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T14:39:03.410 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.411+0000 7f7e1eccf180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T14:39:03.467 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.471+0000 7f7e1eccf180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T14:39:03.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.475+0000 7f4079f1f640 1 Processor -- start 2024-04-17T14:39:03.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.475+0000 7f4079f1f640 1 -- start start 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4074152850 0x7f40740c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f4074158a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4074152c30 0x7f40740c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f40740c85f0 con 0x7f4074152c30 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f407406c7f0 con 0x7f4074152850 2024-04-17T14:39:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4079f1f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f407406ca60 con 0x7f40740c9c00 2024-04-17T14:39:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4074152850 0x7f40740c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4072ffd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f4074158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f4073fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4074152c30 0x7f40740c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4074152850 0x7f40740c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46212/0 (socket says 172.21.15.67:46212) 2024-04-17T14:39:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 -- 172.21.15.67:0/3041344309 learned_addr learned my addr 172.21.15.67:0/3041344309 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:03.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 -- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 msgr2=0x7f4074158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:03.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 --2- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f4074158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 -- 172.21.15.67:0/3041344309 >> v2:172.21.15.16:3300/0 conn(0x7f4074152c30 msgr2=0x7f40740c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:03.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 --2- 172.21.15.67:0/3041344309 >> v2:172.21.15.16:3300/0 conn(0x7f4074152c30 0x7f40740c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.479+0000 7f40737fe640 1 -- 172.21.15.67:0/3041344309 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40740737d0 con 0x7f4074152850 2024-04-17T14:39:03.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.483+0000 7f40737fe640 1 --2- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f40740c7f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40740cb120 tx=0x7f406401c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3d964e0bb7ffe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:03.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f40727fc640 1 -- 172.21.15.67:0/3041344309 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40640a5750 con 0x7f4074152850 2024-04-17T14:39:03.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f40727fc640 1 -- 172.21.15.67:0/3041344309 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40640a58f0 con 0x7f4074152850 2024-04-17T14:39:03.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f40727fc640 1 -- 172.21.15.67:0/3041344309 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40640a5cc0 con 0x7f4074152850 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 -- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 msgr2=0x7f40740c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 --2- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f40740c7f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40740cb120 tx=0x7f406401c9c0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 -- 172.21.15.67:0/3041344309 shutdown_connections 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 --2- 172.21.15.67:0/3041344309 >> v2:172.21.15.16:3300/0 conn(0x7f4074152c30 0x7f40740c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 --2- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f4074158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 --2- 172.21.15.67:0/3041344309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f40740c7f60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.487+0000 7f4079f1f640 1 -- 172.21.15.67:0/3041344309 >> 172.21.15.67:0/3041344309 conn(0x7f40740705b0 msgr2=0x7f4074070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- 172.21.15.67:0/3041344309 shutdown_connections 2024-04-17T14:39:03.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- 172.21.15.67:0/3041344309 wait complete. 2024-04-17T14:39:03.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 Processor -- start 2024-04-17T14:39:03.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- start start 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f407414f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4074152c30 0x7f407414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f407406d240 con 0x7f4074152c30 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f407406ba30 con 0x7f4074152850 2024-04-17T14:39:03.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4079f1f640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f40740c6680 con 0x7f40740c9c00 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f40737fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f407414f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4072ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4073fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4074152c30 0x7f407414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f40737fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f407414f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43210/0 (socket says 172.21.15.67:43210) 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f40737fe640 1 -- 172.21.15.67:0/2712303744 learned_addr learned my addr 172.21.15.67:0/2712303744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:03.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.491+0000 7f4072ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46214/0 (socket says 172.21.15.67:46214) 2024-04-17T14:39:03.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.495+0000 7f4072ffd640 1 -- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 msgr2=0x7f407414f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:03.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.495+0000 7f4072ffd640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f407414f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.495+0000 7f4072ffd640 1 -- 172.21.15.67:0/2712303744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4074152c30 msgr2=0x7f407414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:03.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.495+0000 7f4072ffd640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4074152c30 0x7f407414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.495+0000 7f4072ffd640 1 -- 172.21.15.67:0/2712303744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407415b2c0 con 0x7f4074152850 2024-04-17T14:39:03.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.499+0000 7f4072ffd640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e840 tx=0x7f405c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:03.497 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.496+0000 7fd3b181a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c017070 con 0x7f4074152850 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c00c730 con 0x7f4074152850 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407415cde0 con 0x7f4074152850 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c00cb00 con 0x7f4074152850 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40740c5a70 con 0x7f4074152850 2024-04-17T14:39:03.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.503+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4074076280 con 0x7f4074152850 2024-04-17T14:39:03.564 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.560+0000 7fd3b181a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T14:39:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.623+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f405c01a070 con 0x7f4074152850 2024-04-17T14:39:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.623+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f405c006750 con 0x7f4074152850 2024-04-17T14:39:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.623+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f407415b2c0 con 0x7f4074152850 2024-04-17T14:39:03.632 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.635+0000 7f7e1eccf180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T14:39:03.697 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:03.699+0000 7f7e1eccf180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T14:39:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.711+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f55759fe-4003-42e2-8361-397d42b91329", "id": 1} v 0) -- 0x7f40740c88c0 con 0x7f4074152850 2024-04-17T14:39:03.738 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.736+0000 7fd3b181a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T14:39:03.814 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:03.812+0000 7fd3b181a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T14:39:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.839+0000 7f406bfff640 1 -- 172.21.15.67:0/2712303744 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f55759fe-4003-42e2-8361-397d42b91329", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f405c00cdd0 con 0x7f4074152850 2024-04-17T14:39:03.837 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 msgr2=0x7f407414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e840 tx=0x7f405c00ed00 comp rx=0 tx=0).stop 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 shutdown_connections 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4074152c30 0x7f407414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4074152850 0x7f407414edb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 --2- 172.21.15.67:0/2712303744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40740c9c00 0x7f407414f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 >> 172.21.15.67:0/2712303744 conn(0x7f40740705b0 msgr2=0x7f4074070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 shutdown_connections 2024-04-17T14:39:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:03.843+0000 7f4079f1f640 1 -- 172.21.15.67:0/2712303744 wait complete. 2024-04-17T14:39:03.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 112b128c-3596-4679-93a3-b3217a8a197b 2 2024-04-17T14:39:03.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 Processor -- start 2024-04-17T14:39:04.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 -- start start 2024-04-17T14:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 0x7f26b415e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26b406cd60 0x7f26b40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b4062fe0 con 0x7f26b406ba30 2024-04-17T14:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f26b4063280 con 0x7f26b406cd60 2024-04-17T14:39:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b8dda640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f26b415afa0 con 0x7f26b4154e50 2024-04-17T14:39:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f26b406cd60 0x7f26b40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.003+0000 7f26b1d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f26b406ba30 0x7f26b406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.67:47632/0 (socket says 172.21.15.67:47632) 2024-04-17T14:39:04.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.007+0000 7f26b1d9b640 1 -- 172.21.15.67:0/3568635059 learned_addr learned my addr 172.21.15.67:0/3568635059 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-17T14:39:04.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.007+0000 7f26b259c640 1 --2- 172.21.15.67:0/3568635059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 0x7f26b415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.007+0000 7f26b159a640 1 -- 172.21.15.67:0/3568635059 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422626394 0 0) 0x7f26b4062fe0 con 0x7f26b406ba30 2024-04-17T14:39:04.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.007+0000 7f26b159a640 1 -- 172.21.15.67:0/3568635059 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f269c003530 con 0x7f26b406ba30 2024-04-17T14:39:04.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.011+0000 7f26b259c640 1 -- 172.21.15.67:0/3568635059 >> v2:172.21.15.67:3300/0 conn(0x7f26b406cd60 msgr2=0x7f26b40c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:04.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.011+0000 7f26b259c640 1 --2- 172.21.15.67:0/3568635059 >> v2:172.21.15.67:3300/0 conn(0x7f26b406cd60 0x7f26b40c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.011+0000 7f26b259c640 1 -- 172.21.15.67:0/3568635059 >> v1:172.21.15.16:6789/0 conn(0x7f26b406ba30 legacy=0x7f26b406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.011+0000 7f26b259c640 1 -- 172.21.15.67:0/3568635059 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b415b280 con 0x7f26b4154e50 2024-04-17T14:39:04.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.019+0000 7f26b259c640 1 --2- 172.21.15.67:0/3568635059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 0x7f26b415e240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a80097c0 tx=0x7f26a801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a83313ecc3bc9c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:04.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b159a640 1 -- 172.21.15.67:0/3568635059 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80b5070 con 0x7f26b4154e50 2024-04-17T14:39:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b159a640 1 -- 172.21.15.67:0/3568635059 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a80a8990 con 0x7f26b4154e50 2024-04-17T14:39:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b159a640 1 -- 172.21.15.67:0/3568635059 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a8d60 con 0x7f26b4154e50 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- 172.21.15.67:0/3568635059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 msgr2=0x7f26b415e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 --2- 172.21.15.67:0/3568635059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 0x7f26b415e240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a80097c0 tx=0x7f26a801ecb0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- 172.21.15.67:0/3568635059 shutdown_connections 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 --2- 172.21.15.67:0/3568635059 >> v2:172.21.15.67:3300/0 conn(0x7f26b406cd60 0x7f26b40c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 --2- 172.21.15.67:0/3568635059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b4154e50 0x7f26b415e240 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- 172.21.15.67:0/3568635059 >> 172.21.15.67:0/3568635059 conn(0x7f26b40705b0 msgr2=0x7f26b4070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- 172.21.15.67:0/3568635059 shutdown_connections 2024-04-17T14:39:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- 172.21.15.67:0/3568635059 wait complete. 2024-04-17T14:39:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 Processor -- start 2024-04-17T14:39:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.083+0000 7f26b8dda640 1 -- start start 2024-04-17T14:39:04.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b406ba30 0x7f26b41599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b406cd60 0x7f26b40c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f26b415ba80 con 0x7f26b406ba30 2024-04-17T14:39:04.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26b415ac70 con 0x7f26b4154e50 2024-04-17T14:39:04.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b8dda640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f26b4151850 con 0x7f26b406cd60 2024-04-17T14:39:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46240/0 (socket says 172.21.15.67:46240) 2024-04-17T14:39:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b2d9d640 1 -- 172.21.15.67:0/612828364 learned_addr learned my addr 172.21.15.67:0/612828364 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:04.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.087+0000 7f26b259c640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b406ba30 0x7f26b41599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 -- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b406cd60 msgr2=0x7f26b40c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b406cd60 0x7f26b40c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 -- 172.21.15.67:0/612828364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b406ba30 msgr2=0x7f26b41599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b406ba30 0x7f26b41599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 -- 172.21.15.67:0/612828364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b4151af0 con 0x7f26b4154e50 2024-04-17T14:39:04.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.091+0000 7f26b2d9d640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f26ac007e10 tx=0x7f26ac00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.095+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac014620 con 0x7f26b4154e50 2024-04-17T14:39:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.095+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac019070 con 0x7f26b4154e50 2024-04-17T14:39:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.095+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac014a20 con 0x7f26b4154e50 2024-04-17T14:39:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.095+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b4151dd0 con 0x7f26b4154e50 2024-04-17T14:39:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.095+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41e96f0 con 0x7f26b4154e50 2024-04-17T14:39:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.099+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b41e98f0 con 0x7f26b4154e50 2024-04-17T14:39:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.099+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26ac014bc0 con 0x7f26b4154e50 2024-04-17T14:39:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.099+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f26ac0277f0 con 0x7f26b4154e50 2024-04-17T14:39:04.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.219+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f26b41e98f0 con 0x7f26b4154e50 2024-04-17T14:39:04.299 INFO:tasks.ceph.mgr.x.smithi067.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T14:39:04.299 INFO:tasks.ceph.mgr.x.smithi067.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T14:39:04.299 INFO:tasks.ceph.mgr.x.smithi067.stderr: from numpy import show_config as show_numpy_config 2024-04-17T14:39:04.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.303+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "112b128c-3596-4679-93a3-b3217a8a197b", "id": 2} v 0) -- 0x7f26b4076280 con 0x7f26b4154e50 2024-04-17T14:39:04.381 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:04.383+0000 7f7e1eccf180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T14:39:04.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26a2ffd640 1 -- 172.21.15.67:0/612828364 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "112b128c-3596-4679-93a3-b3217a8a197b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f26ac0273d0 con 0x7f26b4154e50 2024-04-17T14:39:04.435 INFO:teuthology.orchestra.run.smithi067.stdout:2 2024-04-17T14:39:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 msgr2=0x7f26b41e9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f26ac007e10 tx=0x7f26ac00e4b0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 shutdown_connections 2024-04-17T14:39:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26b4154e50 0x7f26b41e9c10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f26b406cd60 0x7f26b40c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 --2- 172.21.15.67:0/612828364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b406ba30 0x7f26b41599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 >> 172.21.15.67:0/612828364 conn(0x7f26b40705b0 msgr2=0x7f26b4152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:04.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 shutdown_connections 2024-04-17T14:39:04.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.439+0000 7f26b8dda640 1 -- 172.21.15.67:0/612828364 wait complete. 2024-04-17T14:39:04.450 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T14:39:04.450 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T14:39:04.450 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-04-17T14:39:04.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 6abe9b5d-23c1-46db-a0f2-3fa0974a422b 3 2024-04-17T14:39:04.498 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:04.496+0000 7fd3b181a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T14:39:04.570 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:04.571+0000 7f7e1eccf180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T14:39:04.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 Processor -- start 2024-04-17T14:39:04.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 -- start start 2024-04-17T14:39:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8664152ec0 0x7f8664070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f866415c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86640c5890 con 0x7f86640c9120 2024-04-17T14:39:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f86640709c0 con 0x7f8664152ec0 2024-04-17T14:39:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.587+0000 7f866a46a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8664070ca0 con 0x7f86640c9540 2024-04-17T14:39:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8668a07640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f866415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f86637fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f86640c9120 0x7f86640cb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.67:47638/0 (socket says 172.21.15.67:47638) 2024-04-17T14:39:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f86637fe640 1 -- 172.21.15.67:0/925293432 learned_addr learned my addr 172.21.15.67:0/925293432 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-17T14:39:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8663fff640 1 --2- 172.21.15.67:0/925293432 >> v2:172.21.15.16:3300/0 conn(0x7f8664152ec0 0x7f8664070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8668a07640 1 -- 172.21.15.67:0/925293432 >> v2:172.21.15.16:3300/0 conn(0x7f8664152ec0 msgr2=0x7f8664070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8668a07640 1 --2- 172.21.15.67:0/925293432 >> v2:172.21.15.16:3300/0 conn(0x7f8664152ec0 0x7f8664070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8668a07640 1 -- 172.21.15.67:0/925293432 >> v1:172.21.15.16:6789/0 conn(0x7f86640c9120 legacy=0x7f86640cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.591+0000 7f8668a07640 1 -- 172.21.15.67:0/925293432 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86640ca4e0 con 0x7f86640c9540 2024-04-17T14:39:04.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.595+0000 7f8668a07640 1 --2- 172.21.15.67:0/925293432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f866415c210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f448a1ecc7dee238 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:04.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.599+0000 7f8662ffd640 1 -- 172.21.15.67:0/925293432 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540b2070 con 0x7f86640c9540 2024-04-17T14:39:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f8662ffd640 1 -- 172.21.15.67:0/925293432 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86540a5a00 con 0x7f86640c9540 2024-04-17T14:39:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f8662ffd640 1 -- 172.21.15.67:0/925293432 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540a5dd0 con 0x7f86640c9540 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 -- 172.21.15.67:0/925293432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 msgr2=0x7f866415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 --2- 172.21.15.67:0/925293432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f866415c210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865401c940 comp rx=0 tx=0).stop 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 -- 172.21.15.67:0/925293432 shutdown_connections 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 --2- 172.21.15.67:0/925293432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f866415c210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 --2- 172.21.15.67:0/925293432 >> v2:172.21.15.16:3300/0 conn(0x7f8664152ec0 0x7f8664070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 -- 172.21.15.67:0/925293432 >> 172.21.15.67:0/925293432 conn(0x7f8664062ca0 msgr2=0x7f866406dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 -- 172.21.15.67:0/925293432 shutdown_connections 2024-04-17T14:39:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.603+0000 7f866a46a640 1 -- 172.21.15.67:0/925293432 wait complete. 2024-04-17T14:39:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 Processor -- start 2024-04-17T14:39:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 -- start start 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 0x7f8664162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f8664144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8664152ec0 0x7f8664161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86641532a0 con 0x7f86640c9120 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86640cad80 con 0x7f8664152ec0 2024-04-17T14:39:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f866a46a640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f86640cb890 con 0x7f86640c9540 2024-04-17T14:39:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f86637fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f8664144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f8663fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 0x7f8664162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f86637fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f8664144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43254/0 (socket says 172.21.15.67:43254) 2024-04-17T14:39:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f86637fe640 1 -- 172.21.15.67:0/2792019700 learned_addr learned my addr 172.21.15.67:0/2792019700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:04.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.607+0000 7f8668a07640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8664152ec0 0x7f8664161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.611+0000 7f8663fff640 1 -- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 msgr2=0x7f8664144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.611+0000 7f8663fff640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f8664144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.611+0000 7f8663fff640 1 -- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8664152ec0 msgr2=0x7f8664161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.611+0000 7f8663fff640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8664152ec0 0x7f8664161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.611+0000 7f8663fff640 1 -- 172.21.15.67:0/2792019700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866406ce00 con 0x7f86640c9120 2024-04-17T14:39:04.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.615+0000 7f8663fff640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 0x7f8664162c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f865c00e870 tx=0x7f865c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c017070 con 0x7f86640c9120 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c00ee60 con 0x7f86640c9120 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c00cb60 con 0x7f86640c9120 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8664163140 con 0x7f86640c9120 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86641f7290 con 0x7f86640c9120 2024-04-17T14:39:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.619+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8664076280 con 0x7f86640c9120 2024-04-17T14:39:04.655 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:04.652+0000 7fd3b181a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T14:39:04.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.723+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f865c01a070 con 0x7f86640c9120 2024-04-17T14:39:04.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.727+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f865c013470 con 0x7f86640c9120 2024-04-17T14:39:04.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.727+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f865c00cd50 con 0x7f86640c9120 2024-04-17T14:39:04.748 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:04.751+0000 7f7e1eccf180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T14:39:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.811+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6abe9b5d-23c1-46db-a0f2-3fa0974a422b", "id": 3} v 0) -- 0x7f86640716d0 con 0x7f86640c9120 2024-04-17T14:39:04.815 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:04.819+0000 7f7e1eccf180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T14:39:04.849 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:04.848+0000 7fd3b181a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T14:39:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f8660ff9640 1 -- 172.21.15.67:0/2792019700 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6abe9b5d-23c1-46db-a0f2-3fa0974a422b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f865c006530 con 0x7f86640c9120 2024-04-17T14:39:04.851 INFO:teuthology.orchestra.run.smithi067.stdout:3 2024-04-17T14:39:04.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 msgr2=0x7f8664162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:04.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 0x7f8664162c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f865c00e870 tx=0x7f865c00ed30 comp rx=0 tx=0).stop 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 shutdown_connections 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8664152ec0 0x7f8664161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86640c9540 0x7f8664144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 --2- 172.21.15.67:0/2792019700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86640c9120 0x7f8664162c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 >> 172.21.15.67:0/2792019700 conn(0x7f8664062ca0 msgr2=0x7f8664151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 shutdown_connections 2024-04-17T14:39:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:04.855+0000 7f866a46a640 1 -- 172.21.15.67:0/2792019700 wait complete. 2024-04-17T14:39:04.874 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 1f957d0f-7b28-45b4-a073-eecbd0190aec 4 2024-04-17T14:39:04.927 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:04.924+0000 7fd3b181a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T14:39:04.968 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:04.971+0000 7f7e1eccf180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T14:39:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 Processor -- start 2024-04-17T14:39:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 -- start start 2024-04-17T14:39:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd180070590 0x7fd18015c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1800c7910 con 0x7fd1800cae60 2024-04-17T14:39:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd180070100 con 0x7fd180070590 2024-04-17T14:39:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.007+0000 7fd186df7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd18015c660 con 0x7fd1800cb240 2024-04-17T14:39:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.011+0000 7fd185394640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.011+0000 7fd17ffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd180070590 0x7fd18015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.011+0000 7fd185394640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43260/0 (socket says 172.21.15.67:43260) 2024-04-17T14:39:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.011+0000 7fd185394640 1 -- 172.21.15.67:0/2299560971 learned_addr learned my addr 172.21.15.67:0/2299560971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.015+0000 7fd185394640 1 -- 172.21.15.67:0/2299560971 >> v2:172.21.15.67:3300/0 conn(0x7fd180070590 msgr2=0x7fd18015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.015+0000 7fd185394640 1 --2- 172.21.15.67:0/2299560971 >> v2:172.21.15.67:3300/0 conn(0x7fd180070590 0x7fd18015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.015+0000 7fd185394640 1 -- 172.21.15.67:0/2299560971 >> v1:172.21.15.67:6789/0 conn(0x7fd1800cae60 legacy=0x7fd180152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.015+0000 7fd185394640 1 -- 172.21.15.67:0/2299560971 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800c7bf0 con 0x7fd1800cb240 2024-04-17T14:39:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.015+0000 7fd185394640 1 --2- 172.21.15.67:0/2299560971 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd170009870 tx=0x7fd17001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21353493534910da server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd17f7fe640 1 -- 172.21.15.67:0/2299560971 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700b5070 con 0x7fd1800cb240 2024-04-17T14:39:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd17f7fe640 1 -- 172.21.15.67:0/2299560971 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1700a8a50 con 0x7fd1800cb240 2024-04-17T14:39:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd17f7fe640 1 -- 172.21.15.67:0/2299560971 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700a8e20 con 0x7fd1800cb240 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- 172.21.15.67:0/2299560971 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 msgr2=0x7fd1801634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- 172.21.15.67:0/2299560971 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd170009870 tx=0x7fd17001ed50 comp rx=0 tx=0).stop 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- 172.21.15.67:0/2299560971 shutdown_connections 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- 172.21.15.67:0/2299560971 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801634b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- 172.21.15.67:0/2299560971 >> v2:172.21.15.67:3300/0 conn(0x7fd180070590 0x7fd18015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- 172.21.15.67:0/2299560971 >> 172.21.15.67:0/2299560971 conn(0x7fd1800cd400 msgr2=0x7fd1800c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- 172.21.15.67:0/2299560971 shutdown_connections 2024-04-17T14:39:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- 172.21.15.67:0/2299560971 wait complete. 2024-04-17T14:39:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 Processor -- start 2024-04-17T14:39:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- start start 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 0x7fd1800c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 0x7fd1801e2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1800c7ed0 con 0x7fd1800cae60 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd18006fd90 con 0x7fd180070590 2024-04-17T14:39:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd186df7640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd1800c8050 con 0x7fd1800cb240 2024-04-17T14:39:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.023+0000 7fd184b93640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 0x7fd1800c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.027+0000 7fd185394640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.027+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 0x7fd1801e2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.027+0000 7fd184b93640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 0x7fd1800c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46266/0 (socket says 172.21.15.67:46266) 2024-04-17T14:39:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.027+0000 7fd184b93640 1 -- 172.21.15.67:0/1811456656 learned_addr learned my addr 172.21.15.67:0/1811456656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 -- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 msgr2=0x7fd1800c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 0x7fd1800c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 -- 172.21.15.67:0/1811456656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 msgr2=0x7fd1801e2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 0x7fd1801e2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 -- 172.21.15.67:0/1811456656 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1801ee7c0 con 0x7fd1800cb240 2024-04-17T14:39:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd17ffff640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 0x7fd1801e2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T14:39:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.031+0000 7fd185394640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801e2880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd1700af000 tx=0x7fd17001baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700b5070 con 0x7fd1800cb240 2024-04-17T14:39:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1801eea80 con 0x7fd1800cb240 2024-04-17T14:39:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1801ef040 con 0x7fd1800cb240 2024-04-17T14:39:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd180076280 con 0x7fd1800cb240 2024-04-17T14:39:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1700a8a50 con 0x7fd1800cb240 2024-04-17T14:39:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.035+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700bb410 con 0x7fd1800cb240 2024-04-17T14:39:05.087 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:05.084+0000 7fd3b181a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T14:39:05.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.279+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd1700c2060 con 0x7fd1800cb240 2024-04-17T14:39:05.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.279+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd1700ba8d0 con 0x7fd1800cb240 2024-04-17T14:39:05.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.279+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fd1700188b0 con 0x7fd1800cb240 2024-04-17T14:39:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.367+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f957d0f-7b28-45b4-a073-eecbd0190aec", "id": 4} v 0) -- 0x7fd180152010 con 0x7fd1800cb240 2024-04-17T14:39:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.579+0000 7fd17d7fa640 1 -- 172.21.15.67:0/1811456656 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f957d0f-7b28-45b4-a073-eecbd0190aec", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd1700c4400 con 0x7fd1800cb240 2024-04-17T14:39:05.577 INFO:teuthology.orchestra.run.smithi067.stdout:4 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 msgr2=0x7fd1801e2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801e2880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd1700af000 tx=0x7fd17001baf0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 shutdown_connections 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1800cb240 0x7fd1801e2880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1800cae60 0x7fd1801e2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 --2- 172.21.15.67:0/1811456656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd180070590 0x7fd1800c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 >> 172.21.15.67:0/1811456656 conn(0x7fd1800cd400 msgr2=0x7fd1801508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 shutdown_connections 2024-04-17T14:39:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.583+0000 7fd186df7640 1 -- 172.21.15.67:0/1811456656 wait complete. 2024-04-17T14:39:05.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 30cc82f3-49bd-40a5-ba7e-93664936002d 5 2024-04-17T14:39:05.652 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:05.655+0000 7f7e1eccf180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T14:39:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 Processor -- start 2024-04-17T14:39:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 -- start start 2024-04-17T14:39:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb578152850 0x7fb5780c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb5780c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb578159140 con 0x7fb5780c9c00 2024-04-17T14:39:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb5780c85f0 con 0x7fb578152850 2024-04-17T14:39:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.727+0000 7fb57cfaf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb57806c7f0 con 0x7fb578152c30 2024-04-17T14:39:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb576d9d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb5780c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb575d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb5780c9c00 0x7fb578158a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50500/0 (socket says 172.21.15.67:50500) 2024-04-17T14:39:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb575d9b640 1 -- 172.21.15.67:0/3219258860 learned_addr learned my addr 172.21.15.67:0/3219258860 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-17T14:39:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb57659c640 1 --2- 172.21.15.67:0/3219258860 >> v2:172.21.15.16:3300/0 conn(0x7fb578152850 0x7fb5780c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb576d9d640 1 -- 172.21.15.67:0/3219258860 >> v2:172.21.15.16:3300/0 conn(0x7fb578152850 msgr2=0x7fb5780c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb576d9d640 1 --2- 172.21.15.67:0/3219258860 >> v2:172.21.15.16:3300/0 conn(0x7fb578152850 0x7fb5780c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb576d9d640 1 -- 172.21.15.67:0/3219258860 >> v1:172.21.15.67:6789/0 conn(0x7fb5780c9c00 legacy=0x7fb578158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.731+0000 7fb576d9d640 1 -- 172.21.15.67:0/3219258860 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57806ca60 con 0x7fb578152c30 2024-04-17T14:39:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.735+0000 7fb576d9d640 1 --2- 172.21.15.67:0/3219258860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb5780c6c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcdc38a548a8e5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:05.734 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:05.735+0000 7f7e1eccf180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T14:39:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57559a640 1 -- 172.21.15.67:0/3219258860 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5680b2070 con 0x7fb578152c30 2024-04-17T14:39:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57559a640 1 -- 172.21.15.67:0/3219258860 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5680a5910 con 0x7fb578152c30 2024-04-17T14:39:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57559a640 1 -- 172.21.15.67:0/3219258860 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5680a5ce0 con 0x7fb578152c30 2024-04-17T14:39:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 -- 172.21.15.67:0/3219258860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 msgr2=0x7fb5780c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/3219258860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb5780c6c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56801c960 comp rx=0 tx=0).stop 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 -- 172.21.15.67:0/3219258860 shutdown_connections 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/3219258860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb5780c6c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/3219258860 >> v2:172.21.15.16:3300/0 conn(0x7fb578152850 0x7fb5780c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 -- 172.21.15.67:0/3219258860 >> 172.21.15.67:0/3219258860 conn(0x7fb5780705b0 msgr2=0x7fb578070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 -- 172.21.15.67:0/3219258860 shutdown_connections 2024-04-17T14:39:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.739+0000 7fb57cfaf640 1 -- 172.21.15.67:0/3219258860 wait complete. 2024-04-17T14:39:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 Processor -- start 2024-04-17T14:39:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 -- start start 2024-04-17T14:39:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 0x7fb5781410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb578152850 0x7fb578149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb57806d240 con 0x7fb5780c9c00 2024-04-17T14:39:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb57806cd20 con 0x7fb578152850 2024-04-17T14:39:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57cfaf640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb578141e80 con 0x7fb578152c30 2024-04-17T14:39:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb576d9d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb575d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb578152850 0x7fb578149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb57659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 0x7fb5781410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb576d9d640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43298/0 (socket says 172.21.15.67:43298) 2024-04-17T14:39:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.743+0000 7fb576d9d640 1 -- 172.21.15.67:0/2350791916 learned_addr learned my addr 172.21.15.67:0/2350791916 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb57659c640 1 -- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 msgr2=0x7fb578143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb57659c640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb57659c640 1 -- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb578152850 msgr2=0x7fb578149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb57659c640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb578152850 0x7fb578149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb57659c640 1 -- 172.21.15.67:0/2350791916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578158f20 con 0x7fb5780c9c00 2024-04-17T14:39:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.747+0000 7fb576d9d640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T14:39:05.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.751+0000 7fb57659c640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 0x7fb5781410b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb57000e870 tx=0x7fb57000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570017070 con 0x7fb5780c9c00 2024-04-17T14:39:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57000c8e0 con 0x7fb5780c9c00 2024-04-17T14:39:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57000cc90 con 0x7fb5780c9c00 2024-04-17T14:39:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781444e0 con 0x7fb5780c9c00 2024-04-17T14:39:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb578141b10 con 0x7fb5780c9c00 2024-04-17T14:39:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.755+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578076280 con 0x7fb5780c9c00 2024-04-17T14:39:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.759+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb57001a070 con 0x7fb5780c9c00 2024-04-17T14:39:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.759+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fb5700065b0 con 0x7fb5780c9c00 2024-04-17T14:39:05.816 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:05.812+0000 7fd3b181a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T14:39:05.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.867+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fb5700067b0 con 0x7fb5780c9c00 2024-04-17T14:39:05.908 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:05.904+0000 7fd3b181a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T14:39:05.932 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:05.935+0000 7f7e1eccf180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T14:39:05.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:05.947+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30cc82f3-49bd-40a5-ba7e-93664936002d", "id": 5} v 0) -- 0x7fb57806d3c0 con 0x7fb5780c9c00 2024-04-17T14:39:06.020 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:06.023+0000 7f7e1eccf180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T14:39:06.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.107+0000 7fb566ffd640 1 -- 172.21.15.67:0/2350791916 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30cc82f3-49bd-40a5-ba7e-93664936002d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fb570006030 con 0x7fb5780c9c00 2024-04-17T14:39:06.107 INFO:teuthology.orchestra.run.smithi067.stdout:5 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 msgr2=0x7fb5781410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 0x7fb5781410b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb57000e870 tx=0x7fb57000ed30 comp rx=0 tx=0).stop 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 shutdown_connections 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb578152c30 0x7fb578143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb578152850 0x7fb578149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 --2- 172.21.15.67:0/2350791916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5780c9c00 0x7fb5781410b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 >> 172.21.15.67:0/2350791916 conn(0x7fb5780705b0 msgr2=0x7fb57814d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 shutdown_connections 2024-04-17T14:39:06.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.111+0000 7fb57cfaf640 1 -- 172.21.15.67:0/2350791916 wait complete. 2024-04-17T14:39:06.123 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:06.120+0000 7fd3b181a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T14:39:06.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new e969e708-f337-4e5f-b3d3-20f8e23ebe70 6 2024-04-17T14:39:06.214 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:06.212+0000 7fd3b181a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T14:39:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.239+0000 7f391dc8b640 1 Processor -- start 2024-04-17T14:39:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.239+0000 7f391dc8b640 1 -- start start 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3918155120 0x7f39180c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39180b1b80 0x7f39180b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3918070500 con 0x7f3918155120 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f391806fa10 con 0x7f39180b1b80 2024-04-17T14:39:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f391dc8b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f39180c7d40 con 0x7f3918075830 2024-04-17T14:39:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3917fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39180b1b80 0x7f39180b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f39177fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3918155120 0x7f39180c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43300/0 (socket says 172.21.15.67:43300) 2024-04-17T14:39:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 -- 172.21.15.67:0/3179334313 learned_addr learned my addr 172.21.15.67:0/3179334313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 -- 172.21.15.67:0/3179334313 >> v2:172.21.15.67:3300/0 conn(0x7f39180b1b80 msgr2=0x7f39180b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 --2- 172.21.15.67:0/3179334313 >> v2:172.21.15.67:3300/0 conn(0x7f39180b1b80 0x7f39180b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 -- 172.21.15.67:0/3179334313 >> v2:172.21.15.16:3300/0 conn(0x7f3918155120 msgr2=0x7f39180c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 --2- 172.21.15.67:0/3179334313 >> v2:172.21.15.16:3300/0 conn(0x7f3918155120 0x7f39180c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.243+0000 7f3916ffd640 1 -- 172.21.15.67:0/3179334313 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918155500 con 0x7f3918075830 2024-04-17T14:39:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.247+0000 7f3916ffd640 1 --2- 172.21.15.67:0/3179334313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3918075d50 tx=0x7f390c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec4711baaaac9c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f39167fc640 1 -- 172.21.15.67:0/3179334313 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b5070 con 0x7f3918075830 2024-04-17T14:39:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f39167fc640 1 -- 172.21.15.67:0/3179334313 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0a89d0 con 0x7f3918075830 2024-04-17T14:39:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f39167fc640 1 -- 172.21.15.67:0/3179334313 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0a8da0 con 0x7f3918075830 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 -- 172.21.15.67:0/3179334313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 msgr2=0x7f39180cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 --2- 172.21.15.67:0/3179334313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3918075d50 tx=0x7f390c01ed10 comp rx=0 tx=0).stop 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 -- 172.21.15.67:0/3179334313 shutdown_connections 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 --2- 172.21.15.67:0/3179334313 >> v2:172.21.15.67:3300/0 conn(0x7f39180b1b80 0x7f39180b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 --2- 172.21.15.67:0/3179334313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f39180cba20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 --2- 172.21.15.67:0/3179334313 >> v2:172.21.15.16:3300/0 conn(0x7f3918155120 0x7f39180c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.251+0000 7f391dc8b640 1 -- 172.21.15.67:0/3179334313 >> 172.21.15.67:0/3179334313 conn(0x7f39180cd400 msgr2=0x7f39180c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- 172.21.15.67:0/3179334313 shutdown_connections 2024-04-17T14:39:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- 172.21.15.67:0/3179334313 wait complete. 2024-04-17T14:39:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 Processor -- start 2024-04-17T14:39:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- start start 2024-04-17T14:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f3918073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39180b1b80 0x7f39181f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 0x7f391814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f391806ff40 con 0x7f3918155120 2024-04-17T14:39:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f391806fc60 con 0x7f39180b1b80 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f391dc8b640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f3918070220 con 0x7f3918075830 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f39177fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f3918073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39180b1b80 0x7f39181f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f3917fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 0x7f391814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f39177fe640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f3918073070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43314/0 (socket says 172.21.15.67:43314) 2024-04-17T14:39:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.255+0000 7f39177fe640 1 -- 172.21.15.67:0/2972195533 learned_addr learned my addr 172.21.15.67:0/2972195533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.259+0000 7f3917fff640 1 -- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 msgr2=0x7f3918073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.259+0000 7f3917fff640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f3918073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.259+0000 7f3917fff640 1 -- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39180b1b80 msgr2=0x7f39181f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.259+0000 7f3917fff640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39180b1b80 0x7f39181f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.259+0000 7f3917fff640 1 -- 172.21.15.67:0/2972195533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39180c4f30 con 0x7f3918155120 2024-04-17T14:39:06.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.263+0000 7f3917fff640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 0x7f391814c820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f391000ef00 tx=0x7f391000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910018020 con 0x7f3918155120 2024-04-17T14:39:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3910014400 con 0x7f3918155120 2024-04-17T14:39:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39180c51a0 con 0x7f3918155120 2024-04-17T14:39:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910009e60 con 0x7f3918155120 2024-04-17T14:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39180c5760 con 0x7f3918155120 2024-04-17T14:39:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.267+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3918076280 con 0x7f3918155120 2024-04-17T14:39:06.366 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:06.371+0000 7f7e1eccf180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T14:39:06.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.371+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f391001b020 con 0x7f3918155120 2024-04-17T14:39:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.379+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f391001c3b0 con 0x7f3918155120 2024-04-17T14:39:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.379+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f3910022030 con 0x7f3918155120 2024-04-17T14:39:06.432 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:06.435+0000 7f7e1eccf180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T14:39:06.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.459+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e969e708-f337-4e5f-b3d3-20f8e23ebe70", "id": 6} v 0) -- 0x7f391814cfd0 con 0x7f3918155120 2024-04-17T14:39:06.564 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:06.560+0000 7fd3b181a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T14:39:06.639 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-17T14:39:06.636+0000 7fd3b181a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T14:39:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f38fffff640 1 -- 172.21.15.67:0/2972195533 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e969e708-f337-4e5f-b3d3-20f8e23ebe70", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f391001d900 con 0x7f3918155120 2024-04-17T14:39:06.667 INFO:teuthology.orchestra.run.smithi067.stdout:6 2024-04-17T14:39:06.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 msgr2=0x7f391814c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 0x7f391814c820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f391000ef00 tx=0x7f391000b480 comp rx=0 tx=0).stop 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 shutdown_connections 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3918155120 0x7f391814c820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39180b1b80 0x7f39181f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 --2- 172.21.15.67:0/2972195533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3918075830 0x7f3918073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 >> 172.21.15.67:0/2972195533 conn(0x7f39180cd400 msgr2=0x7f391815ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 shutdown_connections 2024-04-17T14:39:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.671+0000 7f391dc8b640 1 -- 172.21.15.67:0/2972195533 wait complete. 2024-04-17T14:39:06.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new a2a5b1c4-01c2-4807-a639-ca8ec3a5044d 7 2024-04-17T14:39:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.823+0000 7f66bffb1640 1 Processor -- start 2024-04-17T14:39:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.823+0000 7f66bffb1640 1 -- start start 2024-04-17T14:39:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bffb1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66b80ce9e0 0x7f66b815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bffb1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66b815d1a0 0x7f66b8165960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bffb1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b815b390 con 0x7f66b80ce600 2024-04-17T14:39:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bffb1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f66b815b670 con 0x7f66b815d1a0 2024-04-17T14:39:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bffb1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f66b815b950 con 0x7f66b80ce9e0 2024-04-17T14:39:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bd54c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66b80ce9e0 0x7f66b815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bdd4d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f66b80ce600 0x7f66b815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:50504/0 (socket says 172.21.15.67:50504) 2024-04-17T14:39:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.827+0000 7f66bdd4d640 1 -- 172.21.15.67:0/1936828769 learned_addr learned my addr 172.21.15.67:0/1936828769 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-17T14:39:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.831+0000 7f66bd54c640 1 -- 172.21.15.67:0/1936828769 >> v2:172.21.15.16:3300/0 conn(0x7f66b815d1a0 msgr2=0x7f66b8165960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.831+0000 7f66bd54c640 1 --2- 172.21.15.67:0/1936828769 >> v2:172.21.15.16:3300/0 conn(0x7f66b815d1a0 0x7f66b8165960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.831+0000 7f66bd54c640 1 -- 172.21.15.67:0/1936828769 >> v1:172.21.15.67:6789/0 conn(0x7f66b80ce600 legacy=0x7f66b815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.831+0000 7f66bd54c640 1 -- 172.21.15.67:0/1936828769 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b815bc30 con 0x7f66b80ce9e0 2024-04-17T14:39:06.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.843+0000 7f66bd54c640 1 --2- 172.21.15.67:0/1936828769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce9e0 0x7f66b815ef30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66b806d750 tx=0x7f66a801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24e8a37b36e7dbb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bcd4b640 1 -- 172.21.15.67:0/1936828769 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a80b5070 con 0x7f66b80ce9e0 2024-04-17T14:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bcd4b640 1 -- 172.21.15.67:0/1936828769 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a80a8970 con 0x7f66b80ce9e0 2024-04-17T14:39:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bcd4b640 1 -- 172.21.15.67:0/1936828769 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a80a8d40 con 0x7f66b80ce9e0 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- 172.21.15.67:0/1936828769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce9e0 msgr2=0x7f66b815ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 --2- 172.21.15.67:0/1936828769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce9e0 0x7f66b815ef30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66b806d750 tx=0x7f66a801ec70 comp rx=0 tx=0).stop 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- 172.21.15.67:0/1936828769 shutdown_connections 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 --2- 172.21.15.67:0/1936828769 >> v2:172.21.15.16:3300/0 conn(0x7f66b815d1a0 0x7f66b8165960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 --2- 172.21.15.67:0/1936828769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce9e0 0x7f66b815ef30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- 172.21.15.67:0/1936828769 >> 172.21.15.67:0/1936828769 conn(0x7f66b8062ae0 msgr2=0x7f66b806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- 172.21.15.67:0/1936828769 shutdown_connections 2024-04-17T14:39:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- 172.21.15.67:0/1936828769 wait complete. 2024-04-17T14:39:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 Processor -- start 2024-04-17T14:39:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:06.999+0000 7f66bffb1640 1 -- start start 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce600 0x7f66b81e5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b80ce9e0 0x7f66b8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f66b815afe0 con 0x7f66b80ce9e0 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66b80c9110 con 0x7f66b80ce600 2024-04-17T14:39:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66bffb1640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f66b81e6560 con 0x7f66b815d1a0 2024-04-17T14:39:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66be54e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66be54e640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:43332/0 (socket says 172.21.15.67:43332) 2024-04-17T14:39:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.003+0000 7f66be54e640 1 -- 172.21.15.67:0/3801128996 learned_addr learned my addr 172.21.15.67:0/3801128996 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-17T14:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 -- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce600 msgr2=0x7f66b81e5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce600 0x7f66b81e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 -- 172.21.15.67:0/3801128996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b80ce9e0 msgr2=0x7f66b8158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b80ce9e0 0x7f66b8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 -- 172.21.15.67:0/3801128996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b81e69f0 con 0x7f66b815d1a0 2024-04-17T14:39:07.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.007+0000 7f66be54e640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f66b000b9a0 tx=0x7f66b000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0019070 con 0x7f66b815d1a0 2024-04-17T14:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b000cbc0 con 0x7f66b815d1a0 2024-04-17T14:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0014440 con 0x7f66b815d1a0 2024-04-17T14:39:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b81e5950 con 0x7f66b815d1a0 2024-04-17T14:39:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b81e5f10 con 0x7f66b815d1a0 2024-04-17T14:39:07.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.015+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b8076280 con 0x7f66b815d1a0 2024-04-17T14:39:07.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.031+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 2) ==== 44035+0+0 (secure 0 0 0) 0x7f66b001c070 con 0x7f66b815d1a0 2024-04-17T14:39:07.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.163+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f66b0012500 con 0x7f66b815d1a0 2024-04-17T14:39:07.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.163+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f66b0023020 con 0x7f66b815d1a0 2024-04-17T14:39:07.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.259+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2a5b1c4-01c2-4807-a639-ca8ec3a5044d", "id": 7} v 0) -- 0x7f66b80c8e10 con 0x7f66b815d1a0 2024-04-17T14:39:07.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66ae7fc640 1 -- 172.21.15.67:0/3801128996 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2a5b1c4-01c2-4807-a639-ca8ec3a5044d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f66b001d590 con 0x7f66b815d1a0 2024-04-17T14:39:07.717 INFO:teuthology.orchestra.run.smithi067.stdout:7 2024-04-17T14:39:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 msgr2=0x7f66b813f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f66b000b9a0 tx=0x7f66b000be60 comp rx=0 tx=0).stop 2024-04-17T14:39:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 shutdown_connections 2024-04-17T14:39:07.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66b815d1a0 0x7f66b813f3d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b80ce9e0 0x7f66b8158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 --2- 172.21.15.67:0/3801128996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66b80ce600 0x7f66b81e5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 >> 172.21.15.67:0/3801128996 conn(0x7f66b8062ae0 msgr2=0x7f66b806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 shutdown_connections 2024-04-17T14:39:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-17T14:39:07.719+0000 7f66bffb1640 1 -- 172.21.15.67:0/3801128996 wait complete. 2024-04-17T14:39:07.741 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T14:39:07.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-17T14:39:07.745 INFO:tasks.ceph.osd.0:Started 2024-04-17T14:39:07.745 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T14:39:07.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-17T14:39:07.748 INFO:tasks.ceph.osd.1:Started 2024-04-17T14:39:07.748 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T14:39:07.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-17T14:39:07.751 INFO:tasks.ceph.osd.2:Started 2024-04-17T14:39:07.751 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T14:39:07.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-17T14:39:07.754 INFO:tasks.ceph.osd.3:Started 2024-04-17T14:39:07.754 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T14:39:07.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-17T14:39:07.756 INFO:tasks.ceph.osd.4:Started 2024-04-17T14:39:07.757 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T14:39:07.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-17T14:39:07.758 INFO:tasks.ceph.osd.5:Started 2024-04-17T14:39:07.759 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T14:39:07.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-17T14:39:07.760 INFO:tasks.ceph.osd.6:Started 2024-04-17T14:39:07.761 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T14:39:07.761 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-17T14:39:07.763 INFO:tasks.ceph.osd.7:Started 2024-04-17T14:39:07.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:07.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.940+0000 7fc38b400640 1 Processor -- start 2024-04-17T14:39:07.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.940+0000 7fc38b400640 1 -- start start 2024-04-17T14:39:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc38b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc384153050 0x7fc384159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc38b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc3840c3060 0x7fc3840c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc38b400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc384153430 con 0x7fc3840c8d20 2024-04-17T14:39:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc38b400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc38406ef10 con 0x7fc3840c3060 2024-04-17T14:39:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc38b400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc38406ff20 con 0x7fc384153050 2024-04-17T14:39:07.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc389400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc3840c8d20 0x7fc3840c7190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37640/0 (socket says 172.21.15.16:37640) 2024-04-17T14:39:07.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc389400640 1 -- 172.21.15.16:0/1840115181 learned_addr learned my addr 172.21.15.16:0/1840115181 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:07.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.944+0000 7fc383e00640 1 --2- 172.21.15.16:0/1840115181 >> v2:172.21.15.16:3300/0 conn(0x7fc3840c3060 0x7fc3840c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:07.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.948+0000 7fc383e00640 1 -- 172.21.15.16:0/1840115181 >> v2:172.21.15.67:3300/0 conn(0x7fc384153050 msgr2=0x7fc384159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:07.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.948+0000 7fc383e00640 1 --2- 172.21.15.16:0/1840115181 >> v2:172.21.15.67:3300/0 conn(0x7fc384153050 0x7fc384159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.948+0000 7fc383e00640 1 -- 172.21.15.16:0/1840115181 >> v1:172.21.15.16:6789/0 conn(0x7fc3840c8d20 legacy=0x7fc3840c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.948+0000 7fc383e00640 1 -- 172.21.15.16:0/1840115181 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384159cc0 con 0x7fc3840c3060 2024-04-17T14:39:07.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.952+0000 7fc383e00640 1 --2- 172.21.15.16:0/1840115181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc3840c87e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ca030 tx=0x7fc37001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b52d0f7c7160ae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:07.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc383400640 1 -- 172.21.15.16:0/1840115181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700b5070 con 0x7fc3840c3060 2024-04-17T14:39:07.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc383400640 1 -- 172.21.15.16:0/1840115181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3700a8970 con 0x7fc3840c3060 2024-04-17T14:39:07.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc383400640 1 -- 172.21.15.16:0/1840115181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700a8d40 con 0x7fc3840c3060 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- 172.21.15.16:0/1840115181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 msgr2=0x7fc3840c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 --2- 172.21.15.16:0/1840115181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc3840c87e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ca030 tx=0x7fc37001ec70 comp rx=0 tx=0).stop 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- 172.21.15.16:0/1840115181 shutdown_connections 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 --2- 172.21.15.16:0/1840115181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc3840c87e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 --2- 172.21.15.16:0/1840115181 >> v2:172.21.15.67:3300/0 conn(0x7fc384153050 0x7fc384159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- 172.21.15.16:0/1840115181 >> 172.21.15.16:0/1840115181 conn(0x7fc38406ba30 msgr2=0x7fc38406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- 172.21.15.16:0/1840115181 shutdown_connections 2024-04-17T14:39:07.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- 172.21.15.16:0/1840115181 wait complete. 2024-04-17T14:39:07.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 Processor -- start 2024-04-17T14:39:07.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.960+0000 7fc38b400640 1 -- start start 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc384158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc384153050 0x7fc38414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc38406f440 con 0x7fc3840c3060 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc38406f160 con 0x7fc384153050 2024-04-17T14:39:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc38b400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fc38406f720 con 0x7fc3840c8d20 2024-04-17T14:39:07.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc383e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:07.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc383e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:48182/0 (socket says 172.21.15.16:48182) 2024-04-17T14:39:07.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.964+0000 7fc383e00640 1 -- 172.21.15.16:0/4040269408 learned_addr learned my addr 172.21.15.16:0/4040269408 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.968+0000 7fc383e00640 1 -- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc384153050 msgr2=0x7fc38414ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.968+0000 7fc383e00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc384153050 0x7fc38414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.968+0000 7fc383e00640 1 -- 172.21.15.16:0/4040269408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 msgr2=0x7fc384158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.968+0000 7fc383e00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc384158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.968+0000 7fc383e00640 1 -- 172.21.15.16:0/4040269408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3841eee70 con 0x7fc3840c8d20 2024-04-17T14:39:07.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.972+0000 7fc383e00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b3040 tx=0x7fc37001ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700b5040 con 0x7fc3840c8d20 2024-04-17T14:39:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3700c0070 con 0x7fc3840c8d20 2024-04-17T14:39:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3841589a0 con 0x7fc3840c8d20 2024-04-17T14:39:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700b0a40 con 0x7fc3840c8d20 2024-04-17T14:39:07.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3841ef130 con 0x7fc3840c8d20 2024-04-17T14:39:07.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.976+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc384076280 con 0x7fc3840c8d20 2024-04-17T14:39:07.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.988+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 2) ==== 44035+0+0 (secure 0 0 0) 0x7fc3700b0be0 con 0x7fc3840c8d20 2024-04-17T14:39:07.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:07.988+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc3700aedf0 con 0x7fc3840c8d20 2024-04-17T14:39:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.144+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fc3700187d0 con 0x7fc3840c8d20 2024-04-17T14:39:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.228+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3840c3ba0 con 0x7fc3840c8d20 2024-04-17T14:39:08.380 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T14:39:08.383+0000 7ffa2e2b77c0 -1 Falling back to public interface 2024-04-17T14:39:08.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.408+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mgrmap(e 3) ==== 87825+0+0 (secure 0 0 0) 0x7fc3700cf670 con 0x7fc3840c8d20 2024-04-17T14:39:08.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.408+0000 7fc380c00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 0x7fc36406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:08.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.408+0000 7fc388a00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 0x7fc36406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:08.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.408+0000 7fc388a00640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 0x7fc36406abe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc378009690 tx=0x7fc378006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:08.436 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T14:39:08.439+0000 7f4749b637c0 -1 Falling back to public interface 2024-04-17T14:39:08.445 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:08.447+0000 7f7dc6119640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T14:39:08.477 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T14:39:08.476+0000 7fb90e6d07c0 -1 Falling back to public interface 2024-04-17T14:39:08.478 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T14:39:08.476+0000 7f871c17c7c0 -1 Falling back to public interface 2024-04-17T14:39:08.479 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T14:39:08.483+0000 7feaec6a57c0 -1 Falling back to public interface 2024-04-17T14:39:08.534 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T14:39:08.532+0000 7f1c975c67c0 -1 Falling back to public interface 2024-04-17T14:39:08.536 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T14:39:08.539+0000 7fce36b417c0 -1 Falling back to public interface 2024-04-17T14:39:08.561 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T14:39:08.560+0000 7f5e1ba4a7c0 -1 Falling back to public interface 2024-04-17T14:39:08.660 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T14:39:08.663+0000 7f7dc6119640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T14:39:08.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.672+0000 7fc380c00640 1 -- 172.21.15.16:0/4040269408 <== mon.2 v2:172.21.15.67:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc3700c43c0 con 0x7fc3840c8d20 2024-04-17T14:39:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:08.676 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:07.510170+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 msgr2=0x7fc36406abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 0x7fc36406abe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc378009690 tx=0x7fc378006c00 comp rx=0 tx=0).stop 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 msgr2=0x7fc3841f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b3040 tx=0x7fc37001ba10 comp rx=0 tx=0).stop 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 shutdown_connections 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc3640687f0 0x7fc36406abe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc384153050 0x7fc38414ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3840c8d20 0x7fc3841f2df0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:08.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 --2- 172.21.15.16:0/4040269408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3840c3060 0x7fc384158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:08.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 >> 172.21.15.16:0/4040269408 conn(0x7fc38406ba30 msgr2=0x7fc384074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:08.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 shutdown_connections 2024-04-17T14:39:08.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:08.676+0000 7fc38b400640 1 -- 172.21.15.16:0/4040269408 wait complete. 2024-04-17T14:39:08.696 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T14:39:08.696 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T14:39:09.502 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:09.638 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 Processor -- start 2024-04-17T14:39:09.638 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 -- start start 2024-04-17T14:39:09.639 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 0x7f969c0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.639 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c15c6b0 con 0x7f969c152dc0 2024-04-17T14:39:09.639 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c0c7340 con 0x7f969c0c3190 2024-04-17T14:39:09.639 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.636+0000 7f96a3e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f969c0c6d80 con 0x7f969c070070 2024-04-17T14:39:09.646 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.644+0000 7f96a1400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f969c152dc0 0x7f969c15bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37642/0 (socket says 172.21.15.16:37642) 2024-04-17T14:39:09.647 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.644+0000 7f96a1400640 1 -- 172.21.15.16:0/3638838475 learned_addr learned my addr 172.21.15.16:0/3638838475 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:09.653 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062806611 0 0) 0x7f969c15c6b0 con 0x7f969c152dc0 2024-04-17T14:39:09.653 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9684003530 con 0x7f969c152dc0 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527968945 0 0) 0x7f9684003530 con 0x7f969c152dc0 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 msgr2=0x7f969c0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 0x7f969c0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 >> v1:172.21.15.67:6789/0 conn(0x7f969c0c3190 legacy=0x7f969c163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.652+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c0c7060 con 0x7f969c152dc0 2024-04-17T14:39:09.657 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f9690001680 con 0x7f969c152dc0 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 >> v1:172.21.15.16:6789/0 conn(0x7f969c152dc0 legacy=0x7f969c15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 0x7f96840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9684004130 0x7f9684004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9684004e70 0x7f968400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0c6d80 con 0x7f9684004e70 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9684005610 con 0x7f9684004130 2024-04-17T14:39:09.658 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f968400bf10 con 0x7f969c070070 2024-04-17T14:39:09.660 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.656+0000 7f96a1e00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9684004e70 0x7f968400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:09.663 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.660+0000 7f96a1e00640 1 -- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 msgr2=0x7f96840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:09.663 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.660+0000 7f96a1e00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c070070 0x7f96840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:09.663 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.660+0000 7f96a1e00640 1 -- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9684004130 msgr2=0x7f9684004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:09.663 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.660+0000 7f96a1e00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9684004130 0x7f9684004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:09.663 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.660+0000 7f96a1e00640 1 -- 172.21.15.16:0/3638838475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9684003530 con 0x7f9684004e70 2024-04-17T14:39:09.667 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.664+0000 7f96a1e00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9684004e70 0x7f968400b9d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9694001d80 tx=0x7f969401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91409e678dbf20f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:09.671 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96940ad070 con 0x7f9684004e70 2024-04-17T14:39:09.671 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9694003ba0 con 0x7f9684004e70 2024-04-17T14:39:09.671 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f969be00640 1 -- 172.21.15.16:0/3638838475 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694001950 con 0x7f9684004e70 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 -- 172.21.15.16:0/3638838475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9684004e70 msgr2=0x7f968400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 --2- 172.21.15.16:0/3638838475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9684004e70 0x7f968400b9d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9694001d80 tx=0x7f969401c680 comp rx=0 tx=0).stop 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a1e00640 1 -- 172.21.15.16:0/3638838475 reap_dead start 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 -- 172.21.15.16:0/3638838475 shutdown_connections 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 -- 172.21.15.16:0/3638838475 >> 172.21.15.16:0/3638838475 conn(0x7f969c0cc3b0 msgr2=0x7f969c0cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 -- 172.21.15.16:0/3638838475 shutdown_connections 2024-04-17T14:39:09.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.668+0000 7f96a3e00640 1 -- 172.21.15.16:0/3638838475 wait complete. 2024-04-17T14:39:09.673 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 Processor -- start 2024-04-17T14:39:09.674 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 -- start start 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c15c710 0x7f969c141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f969c15cb70 0x7f969c141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0cbe40 con 0x7f969c06bc90 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0cb920 con 0x7f969c15cb70 2024-04-17T14:39:09.675 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a3e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f969c06f310 con 0x7f969c15c710 2024-04-17T14:39:09.676 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:09.676 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46854/0 (socket says 172.21.15.16:46854) 2024-04-17T14:39:09.676 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.672+0000 7f96a1400640 1 -- 172.21.15.16:0/2637911379 learned_addr learned my addr 172.21.15.16:0/2637911379 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:09.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.676+0000 7f96a1400640 1 -- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c15c710 msgr2=0x7f969c141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:09.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.676+0000 7f96a1400640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c15c710 0x7f969c141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:09.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.676+0000 7f96a1400640 1 -- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f969c15cb70 msgr2=0x7f969c141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:09.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.676+0000 7f96a1400640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f969c15cb70 0x7f969c141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:09.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.676+0000 7f96a1400640 1 -- 172.21.15.16:0/2637911379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c0c36e0 con 0x7f969c06bc90 2024-04-17T14:39:09.681 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.680+0000 7f96a1400640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f969000cad0 tx=0x7f969000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:09.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.688+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690018070 con 0x7f969c06bc90 2024-04-17T14:39:09.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.688+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690004cc0 con 0x7f969c06bc90 2024-04-17T14:39:09.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.688+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690007310 con 0x7f969c06bc90 2024-04-17T14:39:09.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.688+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c073a60 con 0x7f969c06bc90 2024-04-17T14:39:09.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.688+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c15bf10 con 0x7f969c06bc90 2024-04-17T14:39:09.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.692+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c076250 con 0x7f969c06bc90 2024-04-17T14:39:09.713 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.712+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f969001b070 con 0x7f969c06bc90 2024-04-17T14:39:09.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.712+0000 7f9699600640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 0x7f967c06a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:09.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.712+0000 7f96a0a00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 0x7f967c06a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:09.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.712+0000 7f96a0a00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 0x7f967c06a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f969c150ba0 tx=0x7f9688006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:09.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.712+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9690055070 con 0x7f969c06bc90 2024-04-17T14:39:09.972 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:09.968+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9690022020 con 0x7f969c06bc90 2024-04-17T14:39:10.141 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.140+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f969c0c68d0 con 0x7f969c06bc90 2024-04-17T14:39:10.185 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f9699600640 1 -- 172.21.15.16:0/2637911379 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9690056ae0 con 0x7f969c06bc90 2024-04-17T14:39:10.186 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-17T14:39:10.186 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:07.510170+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 msgr2=0x7f967c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 0x7f967c06a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f969c150ba0 tx=0x7f9688006ca0 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 msgr2=0x7f969c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f969000cad0 tx=0x7f969000cf90 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 shutdown_connections 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f967c068370 0x7f967c06a830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f969c15cb70 0x7f969c141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969c15c710 0x7f969c141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 --2- 172.21.15.16:0/2637911379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c06bc90 0x7f969c06c070 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:10.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 >> 172.21.15.16:0/2637911379 conn(0x7f969c0cc3b0 msgr2=0x7f969c0c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:10.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 shutdown_connections 2024-04-17T14:39:10.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:10.184+0000 7f96a3e00640 1 -- 172.21.15.16:0/2637911379 wait complete. 2024-04-17T14:39:10.205 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T14:39:12.215 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T14:39:12.219+0000 7ffa2e2b77c0 -1 osd.7 0 log_to_monitors true 2024-04-17T14:39:12.293 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T14:39:12.295+0000 7f4749b637c0 -1 osd.5 0 log_to_monitors true 2024-04-17T14:39:12.329 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T14:39:12.331+0000 7feaec6a57c0 -1 osd.4 0 log_to_monitors true 2024-04-17T14:39:12.428 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T14:39:12.424+0000 7f871c17c7c0 -1 osd.0 0 log_to_monitors true 2024-04-17T14:39:12.505 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T14:39:12.439+0000 7fce36b417c0 -1 osd.6 0 log_to_monitors true 2024-04-17T14:39:12.505 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T14:39:12.456+0000 7fb90e6d07c0 -1 osd.2 0 log_to_monitors true 2024-04-17T14:39:12.505 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T14:39:12.460+0000 7f1c975c67c0 -1 osd.3 0 log_to_monitors true 2024-04-17T14:39:12.552 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T14:39:12.548+0000 7f5e1ba4a7c0 -1 osd.1 0 log_to_monitors true 2024-04-17T14:39:14.910 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T14:39:14.911+0000 7f4745b0c640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T14:39:14.937 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T14:39:14.939+0000 7ffa2aa72640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T14:39:15.028 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T14:39:15.031+0000 7f473d940640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:15.055 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T14:39:15.059+0000 7ffa22094640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:15.932 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T14:39:15.935+0000 7feae864e640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T14:39:15.933 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T14:39:15.935+0000 7fce32aea640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T14:39:15.983 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T14:39:15.987+0000 7fce2a91e640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:15.999 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T14:39:16.003+0000 7feae0482640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:16.263 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T14:39:16.260+0000 7f8717000640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T14:39:16.268 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T14:39:16.264+0000 7f1c92400640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T14:39:16.302 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T14:39:16.300+0000 7f5e17400640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T14:39:16.317 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T14:39:16.316+0000 7fb909600640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T14:39:16.402 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T14:39:16.400+0000 7fb8ff600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:16.418 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T14:39:16.416+0000 7f870d000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:16.418 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T14:39:16.416+0000 7f1c88400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:16.434 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T14:39:16.432+0000 7f5e0ca00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T14:39:17.011 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:17.144 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.140+0000 7fa3d9e00640 1 Processor -- start 2024-04-17T14:39:17.144 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.140+0000 7fa3d9e00640 1 -- start start 2024-04-17T14:39:17.145 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 0x7fa3d415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:17.145 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d40c7340 con 0x7fa3d4070070 2024-04-17T14:39:17.145 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d9e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d40c6d80 con 0x7fa3d40c3190 2024-04-17T14:39:17.145 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d9e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d40c7060 con 0x7fa3d4152dc0 2024-04-17T14:39:17.146 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d3400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa3d40c3190 0x7fa3d4163330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:51102/0 (socket says 172.21.15.16:51102) 2024-04-17T14:39:17.146 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d3400640 1 -- 172.21.15.16:0/94288430 learned_addr learned my addr 172.21.15.16:0/94288430 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:17.146 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.144+0000 7fa3d2a00640 1 --2- 172.21.15.16:0/94288430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 0x7fa3d415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:17.154 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.152+0000 7fa3d2a00640 1 -- 172.21.15.16:0/94288430 >> v1:172.21.15.67:6789/0 conn(0x7fa3d40c3190 legacy=0x7fa3d4163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.154 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.152+0000 7fa3d2a00640 1 -- 172.21.15.16:0/94288430 >> v1:172.21.15.16:6789/0 conn(0x7fa3d4070070 legacy=0x7fa3d40c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:17.154 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.152+0000 7fa3d2a00640 1 -- 172.21.15.16:0/94288430 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d40cb640 con 0x7fa3d4152dc0 2024-04-17T14:39:17.163 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.160+0000 7fa3d2a00640 1 --2- 172.21.15.16:0/94288430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 0x7fa3d415bfa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4073e80 tx=0x7fa3c401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3601b2ef7b0f026d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:17.185 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d2000640 1 -- 172.21.15.16:0/94288430 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40b5070 con 0x7fa3d4152dc0 2024-04-17T14:39:17.185 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d2000640 1 -- 172.21.15.16:0/94288430 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c40a8970 con 0x7fa3d4152dc0 2024-04-17T14:39:17.185 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d2000640 1 -- 172.21.15.16:0/94288430 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40a8d40 con 0x7fa3d4152dc0 2024-04-17T14:39:17.186 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- 172.21.15.16:0/94288430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 msgr2=0x7fa3d415bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.186 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/94288430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 0x7fa3d415bfa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4073e80 tx=0x7fa3c401ec70 comp rx=0 tx=0).stop 2024-04-17T14:39:17.186 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- 172.21.15.16:0/94288430 shutdown_connections 2024-04-17T14:39:17.186 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/94288430 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d4152dc0 0x7fa3d415bfa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.186 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- 172.21.15.16:0/94288430 >> 172.21.15.16:0/94288430 conn(0x7fa3d40cc3b0 msgr2=0x7fa3d40cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:17.187 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- 172.21.15.16:0/94288430 shutdown_connections 2024-04-17T14:39:17.187 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- 172.21.15.16:0/94288430 wait complete. 2024-04-17T14:39:17.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 Processor -- start 2024-04-17T14:39:17.188 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.184+0000 7fa3d9e00640 1 -- start start 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d40c3190 0x7fa3d41e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d4152dc0 0x7fa3d4072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d406f310 con 0x7fa3d4070070 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40cbe40 con 0x7fa3d4152dc0 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d9e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d41f51f0 con 0x7fa3d40c3190 2024-04-17T14:39:17.189 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:17.190 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45406/0 (socket says 172.21.15.16:45406) 2024-04-17T14:39:17.190 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.188+0000 7fa3d2a00640 1 -- 172.21.15.16:0/1517293092 learned_addr learned my addr 172.21.15.16:0/1517293092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:17.193 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 -- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d40c3190 msgr2=0x7fa3d41e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.193 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d40c3190 0x7fa3d41e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.193 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 -- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d4152dc0 msgr2=0x7fa3d4072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.193 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d4152dc0 0x7fa3d4072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.193 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 -- 172.21.15.16:0/1517293092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d41f0f20 con 0x7fa3d4070070 2024-04-17T14:39:17.195 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.192+0000 7fa3d2a00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa3c401c8a0 tx=0x7fa3c401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:17.199 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40b5040 con 0x7fa3d4070070 2024-04-17T14:39:17.199 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c40c0070 con 0x7fa3d4070070 2024-04-17T14:39:17.200 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40b0ad0 con 0x7fa3d4070070 2024-04-17T14:39:17.200 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d41f1ca0 con 0x7fa3d4070070 2024-04-17T14:39:17.200 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d41f11c0 con 0x7fa3d4070070 2024-04-17T14:39:17.200 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.196+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d4076250 con 0x7fa3d4070070 2024-04-17T14:39:17.490 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.488+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fa3c40b8070 con 0x7fa3d4070070 2024-04-17T14:39:17.490 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.488+0000 7fa3cb400640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 0x7fa3b006a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:17.491 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.488+0000 7fa3cbe00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 0x7fa3b006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:17.492 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.488+0000 7fa3cbe00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 0x7fa3b006a800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4071e40 tx=0x7fa3bc006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:17.513 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.512+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7fa3c40f27b0 con 0x7fa3d4070070 2024-04-17T14:39:17.514 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.512+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa3c40187d0 con 0x7fa3d4070070 2024-04-17T14:39:17.691 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.688+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3d406fe50 con 0x7fa3d4070070 2024-04-17T14:39:17.711 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.708+0000 7fa3cb400640 1 -- 172.21.15.16:0/1517293092 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8029 (secure 0 0 0) 0x7fa3c40f4e10 con 0x7fa3d4070070 2024-04-17T14:39:17.711 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-17T14:39:17.711 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":14,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:15.994756+0000","last_up_change":"2024-04-17T14:39:15.994756+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 msgr2=0x7fa3b006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 0x7fa3b006a800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4071e40 tx=0x7fa3bc006bb0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 msgr2=0x7fa3d4071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa3c401c8a0 tx=0x7fa3c401ba10 comp rx=0 tx=0).stop 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 shutdown_connections 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa3b0068340 0x7fa3b006a800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d4152dc0 0x7fa3d4072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d40c3190 0x7fa3d41e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.714 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 --2- 172.21.15.16:0/1517293092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d4070070 0x7fa3d4071eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:17.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 >> 172.21.15.16:0/1517293092 conn(0x7fa3d40cc3b0 msgr2=0x7fa3d40c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:17.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 shutdown_connections 2024-04-17T14:39:17.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:17.712+0000 7fa3d9e00640 1 -- 172.21.15.16:0/1517293092 wait complete. 2024-04-17T14:39:17.731 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-04-17T14:39:24.538 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:24.669 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 Processor -- start 2024-04-17T14:39:24.669 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 -- start start 2024-04-17T14:39:24.670 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 0x7fbba80cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:24.670 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80c4050 con 0x7fbba8159240 2024-04-17T14:39:24.670 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80c4330 con 0x7fbba80c9160 2024-04-17T14:39:24.670 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbb0200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fbba8158db0 con 0x7fbba8152f40 2024-04-17T14:39:24.671 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbad800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 0x7fbba80cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:24.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbace00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbba80c9160 0x7fbba8071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:40744/0 (socket says 172.21.15.16:40744) 2024-04-17T14:39:24.672 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.668+0000 7fbbace00640 1 -- 172.21.15.16:0/2399574355 learned_addr learned my addr 172.21.15.16:0/2399574355 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:24.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.676+0000 7fbbad800640 1 -- 172.21.15.16:0/2399574355 >> v1:172.21.15.67:6789/0 conn(0x7fbba80c9160 legacy=0x7fbba8071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:24.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.676+0000 7fbbad800640 1 -- 172.21.15.16:0/2399574355 >> v1:172.21.15.16:6789/0 conn(0x7fbba8159240 legacy=0x7fbba8163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:24.679 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.676+0000 7fbbad800640 1 -- 172.21.15.16:0/2399574355 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba80c4610 con 0x7fbba8152f40 2024-04-17T14:39:24.685 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.684+0000 7fbbad800640 1 --2- 172.21.15.16:0/2399574355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 0x7fbba80cac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097f0 tx=0x7fbb9c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1953aadaa29dcff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:24.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbba7e00640 1 -- 172.21.15.16:0/2399574355 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0b5070 con 0x7fbba8152f40 2024-04-17T14:39:24.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbba7e00640 1 -- 172.21.15.16:0/2399574355 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0a89d0 con 0x7fbba8152f40 2024-04-17T14:39:24.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbba7e00640 1 -- 172.21.15.16:0/2399574355 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0a8da0 con 0x7fbba8152f40 2024-04-17T14:39:24.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- 172.21.15.16:0/2399574355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 msgr2=0x7fbba80cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:24.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 --2- 172.21.15.16:0/2399574355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 0x7fbba80cac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097f0 tx=0x7fbb9c01ecd0 comp rx=0 tx=0).stop 2024-04-17T14:39:24.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- 172.21.15.16:0/2399574355 shutdown_connections 2024-04-17T14:39:24.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 --2- 172.21.15.16:0/2399574355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8152f40 0x7fbba80cac10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:24.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- 172.21.15.16:0/2399574355 >> 172.21.15.16:0/2399574355 conn(0x7fbba80702e0 msgr2=0x7fbba80707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:24.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- 172.21.15.16:0/2399574355 shutdown_connections 2024-04-17T14:39:24.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- 172.21.15.16:0/2399574355 wait complete. 2024-04-17T14:39:24.699 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 Processor -- start 2024-04-17T14:39:24.699 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- start start 2024-04-17T14:39:24.700 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:24.700 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba8152f40 0x7fbba80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:24.700 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8159240 0x7fbba8148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbba80c38d0 con 0x7fbba80c9160 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8153320 con 0x7fbba8152f40 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.696+0000 7fbbb0200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fbba80c4bd0 con 0x7fbba8159240 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.700+0000 7fbbad800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.700+0000 7fbbad800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33214/0 (socket says 172.21.15.16:33214) 2024-04-17T14:39:24.701 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.700+0000 7fbbad800640 1 -- 172.21.15.16:0/1031084468 learned_addr learned my addr 172.21.15.16:0/1031084468 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:24.702 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.700+0000 7fbbace00640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba8152f40 0x7fbba80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:24.702 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.700+0000 7fbbae200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8159240 0x7fbba8148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:24.705 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 -- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8159240 msgr2=0x7fbba8148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:24.706 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8159240 0x7fbba8148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:24.706 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 -- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba8152f40 msgr2=0x7fbba80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:24.706 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba8152f40 0x7fbba80b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:24.706 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 -- 172.21.15.16:0/1031084468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba806eb40 con 0x7fbba80c9160 2024-04-17T14:39:24.708 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:24.704+0000 7fbbad800640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097f0 tx=0x7fbb9c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:26.826 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0bf070 con 0x7fbba80c9160 2024-04-17T14:39:26.827 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0b0920 con 0x7fbba80c9160 2024-04-17T14:39:26.827 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0b5040 con 0x7fbba80c9160 2024-04-17T14:39:26.827 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba806cc70 con 0x7fbba80c9160 2024-04-17T14:39:26.827 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba8158880 con 0x7fbba80c9160 2024-04-17T14:39:26.827 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:26.824+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba8069020 con 0x7fbba80c9160 2024-04-17T14:39:30.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:39:30.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:39:32.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.884+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb9c0c2070 con 0x7fbba80c9160 2024-04-17T14:39:32.881 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.884+0000 7fbba5600640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 0x7fbb8806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:32.881 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.884+0000 7fbbace00640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 0x7fbb8806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:32.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.884+0000 7fbbace00640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 0x7fbb8806a890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbba8150da0 tx=0x7fbb94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:32.918 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.920+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fbb9c0f9e60 con 0x7fbba80c9160 2024-04-17T14:39:32.918 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:32.920+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbb9c0c9080 con 0x7fbba80c9160 2024-04-17T14:39:33.110 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.112+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbba8076250 con 0x7fbba80c9160 2024-04-17T14:39:33.957 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbba5600640 1 -- 172.21.15.16:0/1031084468 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12836 (secure 0 0 0) 0x7fbb9c018830 con 0x7fbba80c9160 2024-04-17T14:39:33.957 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-17T14:39:33.957 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":18,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:21.115755+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 msgr2=0x7fbb8806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 0x7fbb8806a890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbba8150da0 tx=0x7fbb94009040 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 msgr2=0x7fbba80cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097f0 tx=0x7fbb9c01ba70 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 shutdown_connections 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbb880683d0 0x7fbb8806a890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbba8159240 0x7fbba8148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba8152f40 0x7fbba80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 --2- 172.21.15.16:0/1031084468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbba80c9160 0x7fbba80cd460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:33.959 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 >> 172.21.15.16:0/1031084468 conn(0x7fbba80702e0 msgr2=0x7fbba80ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:33.960 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 shutdown_connections 2024-04-17T14:39:33.960 INFO:teuthology.misc.health.smithi016.stderr:2024-04-17T14:39:33.960+0000 7fbbb0200640 1 -- 172.21.15.16:0/1031084468 wait complete. 2024-04-17T14:39:33.977 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T14:39:33.977 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T14:39:33.977 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.978 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T14:39:33.978 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-17T14:39:33.981 INFO:tasks.ceph.mds.a:Started 2024-04-17T14:39:33.981 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.981 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T14:39:33.981 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-17T14:39:33.984 INFO:tasks.ceph.mds.c:Started 2024-04-17T14:39:33.984 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.984 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-17T14:39:33.984 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-17T14:39:33.987 INFO:tasks.ceph.mds.e:Started 2024-04-17T14:39:33.987 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.987 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T14:39:33.987 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-17T14:39:33.991 INFO:tasks.ceph.mds.b:Started 2024-04-17T14:39:33.991 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.991 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-17T14:39:33.991 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-17T14:39:33.993 INFO:tasks.ceph.mds.d:Started 2024-04-17T14:39:33.994 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-17T14:39:33.994 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-17T14:39:33.994 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-17T14:39:33.996 INFO:tasks.ceph.mds.f:Started 2024-04-17T14:39:33.996 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T14:39:33.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:34.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.164+0000 7f114a000640 1 Processor -- start 2024-04-17T14:39:34.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.164+0000 7f114a000640 1 -- start start 2024-04-17T14:39:34.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f114a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f11440b1240 0x7f11440cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f114a000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11440ca9a0 con 0x7f114415ed00 2024-04-17T14:39:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f114a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11440c36a0 con 0x7f114415ae60 2024-04-17T14:39:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f114a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f11440c3c60 con 0x7f11440b1240 2024-04-17T14:39:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f1143e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f114415ed00 0x7f11440caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49014/0 (socket says 172.21.15.16:49014) 2024-04-17T14:39:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f1143e00640 1 -- 172.21.15.16:0/567493452 learned_addr learned my addr 172.21.15.16:0/567493452 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:34.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.168+0000 7f1143400640 1 --2- 172.21.15.16:0/567493452 >> v2:172.21.15.67:3300/0 conn(0x7f11440b1240 0x7f11440cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.172+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604956508 0 0) 0x7f11440ca9a0 con 0x7f114415ed00 2024-04-17T14:39:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.172+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1128003530 con 0x7f114415ed00 2024-04-17T14:39:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3023855048 0 0) 0x7f1128003530 con 0x7f114415ed00 2024-04-17T14:39:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 >> v2:172.21.15.67:3300/0 conn(0x7f11440b1240 msgr2=0x7f11440cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 --2- 172.21.15.16:0/567493452 >> v2:172.21.15.67:3300/0 conn(0x7f11440b1240 0x7f11440cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 >> v1:172.21.15.67:6789/0 conn(0x7f114415ae60 legacy=0x7f11440c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11440c3980 con 0x7f114415ed00 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f113c001a00 con 0x7f114415ed00 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 >> v1:172.21.15.16:6789/0 conn(0x7f114415ed00 legacy=0x7f11440caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 0x7f1128003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1128004810 0x7f1128004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11280051d0 0x7f112800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11440c3c60 con 0x7f1128003a10 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f112800c0d0 con 0x7f11280051d0 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f112800c2d0 con 0x7f1128004810 2024-04-17T14:39:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.176+0000 7f113be00640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1128004810 0x7f1128004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.180+0000 7f1143400640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 0x7f1128003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143e00640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11280051d0 0x7f112800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143400640 1 -- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1128004810 msgr2=0x7f1128004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143400640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1128004810 0x7f1128004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143400640 1 -- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11280051d0 msgr2=0x7f112800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143400640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11280051d0 0x7f112800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143400640 1 -- 172.21.15.16:0/567493452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1128003530 con 0x7f1128003a10 2024-04-17T14:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.184+0000 7f1143e00640 1 -- 172.21.15.16:0/567493452 reap_dead start 2024-04-17T14:39:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.188+0000 7f1143400640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 0x7f1128003e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1134009ae0 tx=0x7f113401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe46a473a696bc7e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:34.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11340096b0 con 0x7f1128003a10 2024-04-17T14:39:34.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11340a9440 con 0x7f1128003a10 2024-04-17T14:39:34.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f1142a00640 1 -- 172.21.15.16:0/567493452 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11340a9830 con 0x7f1128003a10 2024-04-17T14:39:34.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 -- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 msgr2=0x7f1128003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 0x7f1128003e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1134009ae0 tx=0x7f113401ca70 comp rx=0 tx=0).stop 2024-04-17T14:39:34.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 -- 172.21.15.16:0/567493452 shutdown_connections 2024-04-17T14:39:34.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 --2- 172.21.15.16:0/567493452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1128003a10 0x7f1128003e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 -- 172.21.15.16:0/567493452 >> 172.21.15.16:0/567493452 conn(0x7f1144062850 msgr2=0x7f114406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:34.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 -- 172.21.15.16:0/567493452 shutdown_connections 2024-04-17T14:39:34.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.196+0000 7f114a000640 1 -- 172.21.15.16:0/567493452 wait complete. 2024-04-17T14:39:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 Processor -- start 2024-04-17T14:39:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 -- start start 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 0x7f11440b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11441f8140 0x7f11440afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11440cf220 con 0x7f11440b03a0 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f114415e870 con 0x7f1128003a10 2024-04-17T14:39:34.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f114a000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f11440c98b0 con 0x7f11441f8140 2024-04-17T14:39:34.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f1143e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f113be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11441f8140 0x7f11440afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f1143e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56038/0 (socket says 172.21.15.16:56038) 2024-04-17T14:39:34.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.200+0000 7f1143e00640 1 -- 172.21.15.16:0/1855436641 learned_addr learned my addr 172.21.15.16:0/1855436641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:34.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143400640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 0x7f11440b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143e00640 1 -- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11441f8140 msgr2=0x7f11440afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143e00640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11441f8140 0x7f11440afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143e00640 1 -- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 msgr2=0x7f11440b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143e00640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 0x7f11440b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143e00640 1 -- 172.21.15.16:0/1855436641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11441f4000 con 0x7f11440b03a0 2024-04-17T14:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.204+0000 7f1143400640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 0x7f11440b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T14:39:34.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.208+0000 7f1143e00640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c002240 tx=0x7f113c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:34.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.212+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c00abc0 con 0x7f11440b03a0 2024-04-17T14:39:34.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.212+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113c018070 con 0x7f11440b03a0 2024-04-17T14:39:34.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.212+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c0133f0 con 0x7f11440b03a0 2024-04-17T14:39:34.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.212+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11441f42c0 con 0x7f11440b03a0 2024-04-17T14:39:34.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.212+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441f4880 con 0x7f11440b03a0 2024-04-17T14:39:34.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.216+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1144076280 con 0x7f11440b03a0 2024-04-17T14:39:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.240+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f113c013590 con 0x7f11440b03a0 2024-04-17T14:39:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.240+0000 7f113b400640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 0x7f112006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.240+0000 7f1143400640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 0x7f112006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.244+0000 7f1143400640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 0x7f112006a8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11340ae000 tx=0x7f11340046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.516+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f113c05e100 con 0x7f11440b03a0 2024-04-17T14:39:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.516+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f113c057f60 con 0x7f11440b03a0 2024-04-17T14:39:34.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.688+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11440ca000 con 0x7f11440b03a0 2024-04-17T14:39:34.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f113b400640 1 -- 172.21.15.16:0/1855436641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12836 (secure 0 0 0) 0x7f113c057860 con 0x7f11440b03a0 2024-04-17T14:39:34.734 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:34.734 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:21.115755+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 msgr2=0x7f112006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 0x7f112006a8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11340ae000 tx=0x7f11340046d0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 msgr2=0x7f114414e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c002240 tx=0x7f113c007bd0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 shutdown_connections 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1120068400 0x7f112006a8c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11440b03a0 0x7f114414e260 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f11441f8140 0x7f11440afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 --2- 172.21.15.16:0/1855436641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1128003a10 0x7f11440b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 >> 172.21.15.16:0/1855436641 conn(0x7f1144062850 msgr2=0x7f114415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:34.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 shutdown_connections 2024-04-17T14:39:34.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.736+0000 7f114a000640 1 -- 172.21.15.16:0/1855436641 wait complete. 2024-04-17T14:39:34.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T14:39:17.815818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T14:39:34.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T14:39:34.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.916+0000 7f912ac00640 1 Processor -- start 2024-04-17T14:39:34.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.916+0000 7f912ac00640 1 -- start start 2024-04-17T14:39:34.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f912ac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91240b11b0 0x7f91240ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f912ac00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f912415bb50 0x7f91240c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:34.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f912ac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91240c4740 con 0x7f912415e440 2024-04-17T14:39:34.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f912ac00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f912415f320 con 0x7f912415bb50 2024-04-17T14:39:34.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f912ac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f912415ed60 con 0x7f91240b11b0 2024-04-17T14:39:34.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f9123e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91240b11b0 0x7f91240ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f9123400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f912415bb50 0x7f91240c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:34.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f9128c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f912415e440 0x7f91240c9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49026/0 (socket says 172.21.15.16:49026) 2024-04-17T14:39:34.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.920+0000 7f9128c00640 1 -- 172.21.15.16:0/4259757279 learned_addr learned my addr 172.21.15.16:0/4259757279 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:34.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.924+0000 7f9123e00640 1 -- 172.21.15.16:0/4259757279 >> v2:172.21.15.16:3300/0 conn(0x7f912415bb50 msgr2=0x7f91240c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:34.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.924+0000 7f9123e00640 1 --2- 172.21.15.16:0/4259757279 >> v2:172.21.15.16:3300/0 conn(0x7f912415bb50 0x7f91240c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:34.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.924+0000 7f9123e00640 1 -- 172.21.15.16:0/4259757279 >> v1:172.21.15.16:6789/0 conn(0x7f912415e440 legacy=0x7f91240c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:34.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.924+0000 7f9123e00640 1 -- 172.21.15.16:0/4259757279 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912415f040 con 0x7f91240b11b0 2024-04-17T14:39:34.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:34.932+0000 7f9123e00640 1 --2- 172.21.15.16:0/4259757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91240b11b0 0x7f91240ceeb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91240c9150 tx=0x7f911401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ecb14315223729 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:38.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.564+0000 7f9122a00640 1 -- 172.21.15.16:0/4259757279 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140b5070 con 0x7f91240b11b0 2024-04-17T14:39:38.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f9122a00640 1 -- 172.21.15.16:0/4259757279 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91140a8990 con 0x7f91240b11b0 2024-04-17T14:39:38.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f9122a00640 1 -- 172.21.15.16:0/4259757279 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140a8dc0 con 0x7f91240b11b0 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 -- 172.21.15.16:0/4259757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91240b11b0 msgr2=0x7f91240ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 --2- 172.21.15.16:0/4259757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91240b11b0 0x7f91240ceeb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91240c9150 tx=0x7f911401ec70 comp rx=0 tx=0).stop 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 -- 172.21.15.16:0/4259757279 shutdown_connections 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 --2- 172.21.15.16:0/4259757279 >> v2:172.21.15.16:3300/0 conn(0x7f912415bb50 0x7f91240c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 --2- 172.21.15.16:0/4259757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91240b11b0 0x7f91240ceeb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 -- 172.21.15.16:0/4259757279 >> 172.21.15.16:0/4259757279 conn(0x7f9124062850 msgr2=0x7f912406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 -- 172.21.15.16:0/4259757279 shutdown_connections 2024-04-17T14:39:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.580+0000 7f912ac00640 1 -- 172.21.15.16:0/4259757279 wait complete. 2024-04-17T14:39:38.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 Processor -- start 2024-04-17T14:39:38.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 -- start start 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91240b11b0 0x7f91240afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f912415bb50 0x7f91241f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f912415b630 con 0x7f91240b11b0 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f912415b350 con 0x7f912415bb50 2024-04-17T14:39:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f912ac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f91240c9b40 con 0x7f912415e440 2024-04-17T14:39:38.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f9128c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f9128c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:48838/0 (socket says 172.21.15.16:48838) 2024-04-17T14:39:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.584+0000 7f9128c00640 1 -- 172.21.15.16:0/2109249411 learned_addr learned my addr 172.21.15.16:0/2109249411 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.588+0000 7f9123400640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f912415bb50 0x7f91241f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.592+0000 7f9128c00640 1 -- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f912415bb50 msgr2=0x7f91241f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.592+0000 7f9128c00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f912415bb50 0x7f91241f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.592+0000 7f9128c00640 1 -- 172.21.15.16:0/2109249411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91240b11b0 msgr2=0x7f91240afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.592+0000 7f9128c00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91240b11b0 0x7f91240afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.592+0000 7f9128c00640 1 -- 172.21.15.16:0/2109249411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91241f3c90 con 0x7f912415e440 2024-04-17T14:39:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.596+0000 7f9128c00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f911c00ca80 tx=0x7f911c00cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:38.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.600+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c017070 con 0x7f912415e440 2024-04-17T14:39:38.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.600+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91241f3f30 con 0x7f912415e440 2024-04-17T14:39:38.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.600+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91241f44f0 con 0x7f912415e440 2024-04-17T14:39:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.600+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9124076280 con 0x7f912415e440 2024-04-17T14:39:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.828+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c00ac30 con 0x7f912415e440 2024-04-17T14:39:38.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.904+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c021060 con 0x7f912415e440 2024-04-17T14:39:38.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.904+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f911c01a070 con 0x7f912415e440 2024-04-17T14:39:38.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.908+0000 7f911be00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 0x7f910406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:38.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.908+0000 7f9123e00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 0x7f910406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:38.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.908+0000 7f9123e00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 0x7f910406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91140b2000 tx=0x7f9114004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.908+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f911c054e80 con 0x7f912415e440 2024-04-17T14:39:38.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:38.920+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f911c056de0 con 0x7f912415e440 2024-04-17T14:39:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:39.100+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91240cb160 con 0x7f912415e440 2024-04-17T14:39:43.716 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-17T14:39:43.786 INFO:tasks.ceph.mds.f.smithi067.stdout:starting mds.f at 2024-04-17T14:39:45.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.320+0000 7f911be00640 1 -- 172.21.15.16:0/2109249411 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f911c05b0e0 con 0x7f912415e440 2024-04-17T14:39:45.319 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-17T14:39:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 msgr2=0x7f910406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 0x7f910406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91140b2000 tx=0x7f9114004740 comp rx=0 tx=0).stop 2024-04-17T14:39:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 msgr2=0x7f91241f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f911c00ca80 tx=0x7f911c00cf40 comp rx=0 tx=0).stop 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 shutdown_connections 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9104068380 0x7f910406a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f912415e440 0x7f91241f0bc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f912415bb50 0x7f91241f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 --2- 172.21.15.16:0/2109249411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91240b11b0 0x7f91240afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 >> 172.21.15.16:0/2109249411 conn(0x7f9124062850 msgr2=0x7f9124071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 shutdown_connections 2024-04-17T14:39:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.324+0000 7f912ac00640 1 -- 172.21.15.16:0/2109249411 wait complete. 2024-04-17T14:39:45.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:39:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 Processor -- start 2024-04-17T14:39:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 -- start start 2024-04-17T14:39:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 0x7fa0b4159330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b40722e0 con 0x7fa0b40c6320 2024-04-17T14:39:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b4070130 con 0x7fa0b40c6700 2024-04-17T14:39:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b4159870 con 0x7fa0b4073c80 2024-04-17T14:39:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 0x7fa0b4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 0x7fa0b4159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:60250/0 (socket says 172.21.15.16:60250) 2024-04-17T14:39:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.512+0000 7fa0b1400640 1 -- 172.21.15.16:0/68879693 learned_addr learned my addr 172.21.15.16:0/68879693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:45.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.520+0000 7fa0b2800640 1 -- 172.21.15.16:0/68879693 >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 msgr2=0x7fa0b4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:45.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.520+0000 7fa0b2800640 1 --2- 172.21.15.16:0/68879693 >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 0x7fa0b4159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:45.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.520+0000 7fa0b2800640 1 -- 172.21.15.16:0/68879693 >> v1:172.21.15.67:6789/0 conn(0x7fa0b40c6320 legacy=0x7fa0b406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:45.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.520+0000 7fa0b2800640 1 -- 172.21.15.16:0/68879693 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b415bed0 con 0x7fa0b4073c80 2024-04-17T14:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:45.524+0000 7fa0b2800640 1 --2- 172.21.15.16:0/68879693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4152600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed18ea4e4937506 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:45.562 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-17T14:39:45.574 INFO:tasks.ceph.mds.e.smithi016.stdout:starting mds.e at 2024-04-17T14:39:45.655 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2024-04-17T14:39:45.674 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-04-17T14:39:49.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.932+0000 7fa0b0a00640 1 -- 172.21.15.16:0/68879693 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0b2070 con 0x7fa0b4073c80 2024-04-17T14:39:49.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b0a00640 1 -- 172.21.15.16:0/68879693 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0a58e0 con 0x7fa0b4073c80 2024-04-17T14:39:49.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b0a00640 1 -- 172.21.15.16:0/68879693 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0a5d10 con 0x7fa0b4073c80 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- 172.21.15.16:0/68879693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 msgr2=0x7fa0b4152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 --2- 172.21.15.16:0/68879693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4152600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac01c930 comp rx=0 tx=0).stop 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- 172.21.15.16:0/68879693 shutdown_connections 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 --2- 172.21.15.16:0/68879693 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4152600 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 --2- 172.21.15.16:0/68879693 >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6700 0x7fa0b4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- 172.21.15.16:0/68879693 >> 172.21.15.16:0/68879693 conn(0x7fa0b406db90 msgr2=0x7fa0b406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- 172.21.15.16:0/68879693 shutdown_connections 2024-04-17T14:39:49.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- 172.21.15.16:0/68879693 wait complete. 2024-04-17T14:39:49.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 Processor -- start 2024-04-17T14:39:49.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.936+0000 7fa0b3200640 1 -- start start 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6320 0x7fa0b4143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4152f50 con 0x7fa0b40c6700 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b415c450 con 0x7fa0b40c6320 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b4071fa0 con 0x7fa0b4073c80 2024-04-17T14:39:49.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:49.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46004/0 (socket says 172.21.15.16:46004) 2024-04-17T14:39:49.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b2800640 1 -- 172.21.15.16:0/473823149 learned_addr learned my addr 172.21.15.16:0/473823149 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:49.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.940+0000 7fa0b1400640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6320 0x7fa0b4143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:49.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.944+0000 7fa0b2800640 1 -- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 msgr2=0x7fa0b4146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.944+0000 7fa0b2800640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.944+0000 7fa0b2800640 1 -- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6320 msgr2=0x7fa0b4143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.944+0000 7fa0b2800640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6320 0x7fa0b4143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.944+0000 7fa0b2800640 1 -- 172.21.15.16:0/473823149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b4145e40 con 0x7fa0b40c6700 2024-04-17T14:39:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.948+0000 7fa0b2800640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac01afe0 tx=0x7fa0ac0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:49.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.960+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0b2050 con 0x7fa0b40c6700 2024-04-17T14:39:49.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.960+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0bf070 con 0x7fa0b40c6700 2024-04-17T14:39:49.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.960+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac004440 con 0x7fa0b40c6700 2024-04-17T14:39:49.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.960+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b41f2520 con 0x7fa0b40c6700 2024-04-17T14:39:49.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.960+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b4147420 con 0x7fa0b40c6700 2024-04-17T14:39:49.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:49.964+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b40761a0 con 0x7fa0b40c6700 2024-04-17T14:39:50.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.400+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0ac0045e0 con 0x7fa0b40c6700 2024-04-17T14:39:50.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.400+0000 7fa0aa000640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 0x7fa09406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:50.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.400+0000 7fa0b1e00640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 0x7fa09406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:50.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.404+0000 7fa0b1e00640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 0x7fa09406a890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009670 tx=0x7fa0a4006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:50.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.424+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa0ac0f0140 con 0x7fa0b40c6700 2024-04-17T14:39:50.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.424+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa0ac016520 con 0x7fa0b40c6700 2024-04-17T14:39:50.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.632+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0b4163040 con 0x7fa0b40c6700 2024-04-17T14:39:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.648+0000 7fa0aa000640 1 -- 172.21.15.16:0/473823149 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fa0ac0f27a0 con 0x7fa0b40c6700 2024-04-17T14:39:50.648 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:50.648 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T14:39:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-04-17T14:39:50.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 msgr2=0x7fa09406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 0x7fa09406a890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009670 tx=0x7fa0a4006bd0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 msgr2=0x7fa0b4143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac01afe0 tx=0x7fa0ac0196d0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 shutdown_connections 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0940683d0 0x7fa09406a890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b40c6700 0x7fa0b4143980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6320 0x7fa0b4143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 --2- 172.21.15.16:0/473823149 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4073c80 0x7fa0b4146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 >> 172.21.15.16:0/473823149 conn(0x7fa0b406db90 msgr2=0x7fa0b40702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 shutdown_connections 2024-04-17T14:39:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:50.652+0000 7fa0b3200640 1 -- 172.21.15.16:0/473823149 wait complete. 2024-04-17T14:39:52.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:39:52.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 Processor -- start 2024-04-17T14:39:52.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 -- start start 2024-04-17T14:39:52.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48780c5a20 0x7f48780c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:52.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4878158610 con 0x7f487815be40 2024-04-17T14:39:52.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48781588f0 con 0x7f4878151db0 2024-04-17T14:39:52.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.820+0000 7f487ec00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f48780c8be0 con 0x7f48780c5a20 2024-04-17T14:39:52.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f487cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48780c5a20 0x7f48780c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:52.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f486fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f487815be40 0x7f48780c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44520/0 (socket says 172.21.15.16:44520) 2024-04-17T14:39:52.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f486fe00640 1 -- 172.21.15.16:0/2644411818 learned_addr learned my addr 172.21.15.16:0/2644411818 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:52.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f487cc00640 1 -- 172.21.15.16:0/2644411818 >> v1:172.21.15.67:6789/0 conn(0x7f4878151db0 legacy=0x7f4878157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:52.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f487cc00640 1 -- 172.21.15.16:0/2644411818 >> v1:172.21.15.16:6789/0 conn(0x7f487815be40 legacy=0x7f48780c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:52.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.824+0000 7f487cc00640 1 -- 172.21.15.16:0/2644411818 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487815b360 con 0x7f48780c5a20 2024-04-17T14:39:52.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.828+0000 7f487cc00640 1 --2- 172.21.15.16:0/2644411818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780c5a20 0x7f48780c86a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4870009d90 tx=0x7f487001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e672891d3963a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:52.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f4877400640 1 -- 172.21.15.16:0/2644411818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700b4070 con 0x7f48780c5a20 2024-04-17T14:39:52.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f4877400640 1 -- 172.21.15.16:0/2644411818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700af600 con 0x7f48780c5a20 2024-04-17T14:39:52.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f4877400640 1 -- 172.21.15.16:0/2644411818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700af9d0 con 0x7f48780c5a20 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 -- 172.21.15.16:0/2644411818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780c5a20 msgr2=0x7f48780c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 --2- 172.21.15.16:0/2644411818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780c5a20 0x7f48780c86a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4870009d90 tx=0x7f487001f150 comp rx=0 tx=0).stop 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 -- 172.21.15.16:0/2644411818 shutdown_connections 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 --2- 172.21.15.16:0/2644411818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780c5a20 0x7f48780c86a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 -- 172.21.15.16:0/2644411818 >> 172.21.15.16:0/2644411818 conn(0x7f487806ba30 msgr2=0x7f487806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:52.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.832+0000 7f487ec00640 1 -- 172.21.15.16:0/2644411818 shutdown_connections 2024-04-17T14:39:52.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 -- 172.21.15.16:0/2644411818 wait complete. 2024-04-17T14:39:52.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 Processor -- start 2024-04-17T14:39:52.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 -- start start 2024-04-17T14:39:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48780c5a20 0x7f4878153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f487815be40 0x7f48780cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f487815b920 con 0x7f4878151db0 2024-04-17T14:39:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4878071b30 con 0x7f48780c5a20 2024-04-17T14:39:52.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f487ec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f48781582e0 con 0x7f487815be40 2024-04-17T14:39:52.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.836+0000 7f486fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:52.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36712/0 (socket says 172.21.15.16:36712) 2024-04-17T14:39:52.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 -- 172.21.15.16:0/1431423299 learned_addr learned my addr 172.21.15.16:0/1431423299 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:52.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f4877e00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48780c5a20 0x7f4878153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:52.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f487cc00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f487815be40 0x7f48780cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:52.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 -- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f487815be40 msgr2=0x7f48780cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:52.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f487815be40 0x7f48780cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:52.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 -- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48780c5a20 msgr2=0x7f4878153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:52.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48780c5a20 0x7f4878153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:52.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.840+0000 7f486fe00640 1 -- 172.21.15.16:0/1431423299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48781f18e0 con 0x7f4878151db0 2024-04-17T14:39:52.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.844+0000 7f486fe00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f486000c450 tx=0x7f486000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860017070 con 0x7f4878151db0 2024-04-17T14:39:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4860005cf0 con 0x7f4878151db0 2024-04-17T14:39:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860007290 con 0x7f4878151db0 2024-04-17T14:39:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4878157bd0 con 0x7f4878151db0 2024-04-17T14:39:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48781541b0 con 0x7f4878151db0 2024-04-17T14:39:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.848+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48781580f0 con 0x7f4878151db0 2024-04-17T14:39:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.868+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f486001a070 con 0x7f4878151db0 2024-04-17T14:39:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.872+0000 7f4874c00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 0x7f485406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.872+0000 7f4877e00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 0x7f485406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:52.872+0000 7f4877e00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 0x7f485406a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4868001810 tx=0x7f4868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:53.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.132+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4860054080 con 0x7f4878151db0 2024-04-17T14:39:53.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.132+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4860021020 con 0x7f4878151db0 2024-04-17T14:39:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.344+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4878076280 con 0x7f4878151db0 2024-04-17T14:39:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f4874c00640 1 -- 172.21.15.16:0/1431423299 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5510 (secure 0 0 0) 0x7f4860055fe0 con 0x7f4878151db0 2024-04-17T14:39:53.354 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:53.354 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14216,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-17T14:39:53.354 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 msgr2=0x7f485406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 0x7f485406a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4868001810 tx=0x7f4868009040 comp rx=0 tx=0).stop 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 msgr2=0x7f4878153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f486000c450 tx=0x7f486000c910 comp rx=0 tx=0).stop 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 shutdown_connections 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f48540683d0 0x7f485406a890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f487815be40 0x7f48780cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4878151db0 0x7f4878153180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 --2- 172.21.15.16:0/1431423299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48780c5a20 0x7f4878153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 >> 172.21.15.16:0/1431423299 conn(0x7f487806ba30 msgr2=0x7f48780c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 shutdown_connections 2024-04-17T14:39:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.356+0000 7f487ec00640 1 -- 172.21.15.16:0/1431423299 wait complete. 2024-04-17T14:39:53.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:53.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.516+0000 7f8c02c00640 1 Processor -- start 2024-04-17T14:39:53.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.520+0000 7f8c02c00640 1 -- start start 2024-04-17T14:39:53.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.520+0000 7f8c02c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bfc062a90 0x7f8bfc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:53.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.520+0000 7f8c02c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0c8a10 con 0x7f8bfc0626b0 2024-04-17T14:39:53.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.520+0000 7f8c02c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0c8cf0 con 0x7f8bfc155300 2024-04-17T14:39:53.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.520+0000 7f8c02c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0c8fd0 con 0x7f8bfc062a90 2024-04-17T14:39:53.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.528+0000 7f8c00c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bfc062a90 0x7f8bfc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:53.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.532+0000 7f8bfb400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8bfc155300 0x7f8bfc15b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:58842/0 (socket says 172.21.15.16:58842) 2024-04-17T14:39:53.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.532+0000 7f8bfb400640 1 -- 172.21.15.16:0/1843982569 learned_addr learned my addr 172.21.15.16:0/1843982569 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.540+0000 7f8c00c00640 1 -- 172.21.15.16:0/1843982569 >> v1:172.21.15.67:6789/0 conn(0x7f8bfc155300 legacy=0x7f8bfc15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.540+0000 7f8c00c00640 1 -- 172.21.15.16:0/1843982569 >> v1:172.21.15.16:6789/0 conn(0x7f8bfc0626b0 legacy=0x7f8bfc154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.540+0000 7f8c00c00640 1 -- 172.21.15.16:0/1843982569 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc0c92b0 con 0x7f8bfc062a90 2024-04-17T14:39:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.548+0000 7f8c00c00640 1 --2- 172.21.15.16:0/1843982569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc0cab00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf401f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b91fd236cbe1dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8bfaa00640 1 -- 172.21.15.16:0/1843982569 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b4070 con 0x7f8bfc062a90 2024-04-17T14:39:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8bfaa00640 1 -- 172.21.15.16:0/1843982569 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40af600 con 0x7f8bfc062a90 2024-04-17T14:39:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8bfaa00640 1 -- 172.21.15.16:0/1843982569 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40af9d0 con 0x7f8bfc062a90 2024-04-17T14:39:53.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 -- 172.21.15.16:0/1843982569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 msgr2=0x7f8bfc0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1843982569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc0cab00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf401f120 comp rx=0 tx=0).stop 2024-04-17T14:39:53.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 -- 172.21.15.16:0/1843982569 shutdown_connections 2024-04-17T14:39:53.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1843982569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc0cab00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 -- 172.21.15.16:0/1843982569 >> 172.21.15.16:0/1843982569 conn(0x7f8bfc0cdb60 msgr2=0x7f8bfc0c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:53.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 -- 172.21.15.16:0/1843982569 shutdown_connections 2024-04-17T14:39:53.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.660+0000 7f8c02c00640 1 -- 172.21.15.16:0/1843982569 wait complete. 2024-04-17T14:39:53.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 Processor -- start 2024-04-17T14:39:53.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 -- start start 2024-04-17T14:39:53.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bfc0626b0 0x7f8bfc1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:53.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc1f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:53.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:53.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc15ba70 con 0x7f8bfc155300 2024-04-17T14:39:53.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc15b8f0 con 0x7f8bfc062a90 2024-04-17T14:39:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c02c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc1f0a40 con 0x7f8bfc0626b0 2024-04-17T14:39:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c00c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c00c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36728/0 (socket says 172.21.15.16:36728) 2024-04-17T14:39:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8c00c00640 1 -- 172.21.15.16:0/1894151093 learned_addr learned my addr 172.21.15.16:0/1894151093 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.664+0000 7f8bfbe00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bfc0626b0 0x7f8bfc1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.668+0000 7f8c00c00640 1 -- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bfc0626b0 msgr2=0x7f8bfc1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.668+0000 7f8c00c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bfc0626b0 0x7f8bfc1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.668+0000 7f8c00c00640 1 -- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 msgr2=0x7f8bfc1f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.668+0000 7f8c00c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc1f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.668+0000 7f8c00c00640 1 -- 172.21.15.16:0/1894151093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc1e47e0 con 0x7f8bfc155300 2024-04-17T14:39:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.672+0000 7f8c00c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bf401cd50 tx=0x7f8bf401bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b4040 con 0x7f8bfc155300 2024-04-17T14:39:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc1f4470 con 0x7f8bfc155300 2024-04-17T14:39:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc1f4a30 con 0x7f8bfc155300 2024-04-17T14:39:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc076280 con 0x7f8bfc155300 2024-04-17T14:39:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40c2070 con 0x7f8bfc155300 2024-04-17T14:39:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:53.676+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40c7660 con 0x7f8bfc155300 2024-04-17T14:39:54.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.004+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bf40c7800 con 0x7f8bfc155300 2024-04-17T14:39:54.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.004+0000 7f8bf3e00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 0x7f8bdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.004+0000 7f8bfbe00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 0x7f8bdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.004+0000 7f8bfbe00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 0x7f8bdc06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b810 tx=0x7f8bec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:54.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.020+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8bf40fc510 con 0x7f8bfc155300 2024-04-17T14:39:54.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.020+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8bf4018c80 con 0x7f8bfc155300 2024-04-17T14:39:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.188+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bfc06c080 con 0x7f8bfc155300 2024-04-17T14:39:54.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.212+0000 7f8bf3e00640 1 -- 172.21.15.16:0/1894151093 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12836 (secure 0 0 0) 0x7f8bf40fc030 con 0x7f8bfc155300 2024-04-17T14:39:54.212 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:54.213 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:21.115755+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:39:54.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 msgr2=0x7f8bdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 0x7f8bdc06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b810 tx=0x7f8bec008040 comp rx=0 tx=0).stop 2024-04-17T14:39:54.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 msgr2=0x7f8bfc14ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bf401cd50 tx=0x7f8bf401bec0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 shutdown_connections 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8bdc068380 0x7f8bdc06a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc155300 0x7f8bfc14ac90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bfc062a90 0x7f8bfc1f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 --2- 172.21.15.16:0/1894151093 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8bfc0626b0 0x7f8bfc1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 >> 172.21.15.16:0/1894151093 conn(0x7f8bfc0cdb60 msgr2=0x7f8bfc15a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 shutdown_connections 2024-04-17T14:39:54.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.216+0000 7f8c02c00640 1 -- 172.21.15.16:0/1894151093 wait complete. 2024-04-17T14:39:54.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T14:39:17.815818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T14:39:54.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T14:39:54.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 Processor -- start 2024-04-17T14:39:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 -- start start 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19000c9120 0x7f190006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1900070910 con 0x7f19000c9e60 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1900070bd0 con 0x7f1900070400 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f1906400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1900070eb0 con 0x7f19000c9120 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f18ff400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f19000c9e60 0x7f19000713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44524/0 (socket says 172.21.15.16:44524) 2024-04-17T14:39:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f18ff400640 1 -- 172.21.15.16:0/2857474732 learned_addr learned my addr 172.21.15.16:0/2857474732 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.380+0000 7f18f6a00640 1 --2- 172.21.15.16:0/2857474732 >> v2:172.21.15.67:3300/0 conn(0x7f19000c9120 0x7f190006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.384+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331705428 0 0) 0x7f1900070910 con 0x7f19000c9e60 2024-04-17T14:39:54.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.384+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e4003530 con 0x7f19000c9e60 2024-04-17T14:39:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3678056739 0 0) 0x7f18e4003530 con 0x7f19000c9e60 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 >> v2:172.21.15.67:3300/0 conn(0x7f19000c9120 msgr2=0x7f190006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 --2- 172.21.15.16:0/2857474732 >> v2:172.21.15.67:3300/0 conn(0x7f19000c9120 0x7f190006ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 >> v1:172.21.15.67:6789/0 conn(0x7f1900070400 legacy=0x7f19001657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190015b2a0 con 0x7f19000c9e60 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f18f0001680 con 0x7f19000c9e60 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 >> v1:172.21.15.16:6789/0 conn(0x7f19000c9e60 legacy=0x7f19000713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18e4003a10 0x7f18e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4004810 0x7f18e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 0x7f18e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1900070eb0 con 0x7f18e4005220 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18e400c160 con 0x7f18e4004810 2024-04-17T14:39:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.388+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f18e400c360 con 0x7f18e4003a10 2024-04-17T14:39:54.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ff400640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18e4003a10 0x7f18e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 0x7f18e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 -- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18e4003a10 msgr2=0x7f18e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:54.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18e4003a10 0x7f18e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 -- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4004810 msgr2=0x7f18e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:54.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4004810 0x7f18e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.392+0000 7f18ffe00640 1 -- 172.21.15.16:0/2857474732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e4003530 con 0x7f18e4005220 2024-04-17T14:39:54.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.396+0000 7f18ffe00640 1 -- 172.21.15.16:0/2857474732 reap_dead start 2024-04-17T14:39:54.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.400+0000 7f18ffe00640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 0x7f18e400b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001e40 tx=0x7f18f801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a7eb58d1fbfb4c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:54.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8001a90 con 0x7f18e4005220 2024-04-17T14:39:54.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f8003b80 con 0x7f18e4005220 2024-04-17T14:39:54.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f18fea00640 1 -- 172.21.15.16:0/2857474732 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8005020 con 0x7f18e4005220 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 -- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 msgr2=0x7f18e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 0x7f18e400b9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001e40 tx=0x7f18f801c760 comp rx=0 tx=0).stop 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 -- 172.21.15.16:0/2857474732 shutdown_connections 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 --2- 172.21.15.16:0/2857474732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e4005220 0x7f18e400b9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 -- 172.21.15.16:0/2857474732 >> 172.21.15.16:0/2857474732 conn(0x7f190006dc40 msgr2=0x7f190006e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 -- 172.21.15.16:0/2857474732 shutdown_connections 2024-04-17T14:39:54.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.404+0000 7f1906400640 1 -- 172.21.15.16:0/2857474732 wait complete. 2024-04-17T14:39:54.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 Processor -- start 2024-04-17T14:39:54.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 -- start start 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4005220 0x7f19000c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f19001f4680 0x7f19000ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f190015af50 con 0x7f19001e1500 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f190015b860 con 0x7f18e4005220 2024-04-17T14:39:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f1906400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f190015bd80 con 0x7f19001f4680 2024-04-17T14:39:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f18ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f18ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36736/0 (socket says 172.21.15.16:36736) 2024-04-17T14:39:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f18ffe00640 1 -- 172.21.15.16:0/4205957784 learned_addr learned my addr 172.21.15.16:0/4205957784 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.408+0000 7f18f6a00640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f19001f4680 0x7f19000ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.412+0000 7f18ffe00640 1 -- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f19001f4680 msgr2=0x7f19000ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.412+0000 7f18ffe00640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f19001f4680 0x7f19000ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.412+0000 7f18ffe00640 1 -- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4005220 msgr2=0x7f19000c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.412+0000 7f18ffe00640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4005220 0x7f19000c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.412+0000 7f18ffe00640 1 -- 172.21.15.16:0/4205957784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19000c6cb0 con 0x7f19001e1500 2024-04-17T14:39:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.416+0000 7f18ffe00640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18f8098170 tx=0x7f18e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:54.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8007dc0 con 0x7f19001e1500 2024-04-17T14:39:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80ad070 con 0x7f19001e1500 2024-04-17T14:39:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8001a90 con 0x7f19001e1500 2024-04-17T14:39:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19000c6f90 con 0x7f19001e1500 2024-04-17T14:39:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19001f0d20 con 0x7f19001e1500 2024-04-17T14:39:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.420+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900076280 con 0x7f19001e1500 2024-04-17T14:39:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.440+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18f80af030 con 0x7f19001e1500 2024-04-17T14:39:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.440+0000 7f18f7e00640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 0x7f18dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:54.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.440+0000 7f18ff400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 0x7f18dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:54.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.440+0000 7f18ff400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 0x7f18dc06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000c10 tx=0x7f18f0007f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:54.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.708+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f18f80ee4d0 con 0x7f19001e1500 2024-04-17T14:39:54.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.708+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f18f8016470 con 0x7f19001e1500 2024-04-17T14:39:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.880+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f190006e520 con 0x7f19001e1500 2024-04-17T14:39:54.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.900+0000 7f18f7e00640 1 -- 172.21.15.16:0/4205957784 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f18f80f0430 con 0x7f19001e1500 2024-04-17T14:39:54.899 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 msgr2=0x7f18dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 0x7f18dc06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000c10 tx=0x7f18f0007f80 comp rx=0 tx=0).stop 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 msgr2=0x7f1900157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18f8098170 tx=0x7f18e4005840 comp rx=0 tx=0).stop 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 shutdown_connections 2024-04-17T14:39:54.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18dc0683b0 0x7f18dc06a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19001e1500 0x7f1900157d60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f19001f4680 0x7f19000ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 --2- 172.21.15.16:0/4205957784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e4005220 0x7f19000c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 >> 172.21.15.16:0/4205957784 conn(0x7f190006dc40 msgr2=0x7f19000af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 shutdown_connections 2024-04-17T14:39:54.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:54.904+0000 7f1906400640 1 -- 172.21.15.16:0/4205957784 wait complete. 2024-04-17T14:39:54.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T14:39:55.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 Processor -- start 2024-04-17T14:39:55.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 -- start start 2024-04-17T14:39:55.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8e415eea0 0x7ff8e4070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8e415e370 0x7ff8e40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e415f280 con 0x7ff8e40c5310 2024-04-17T14:39:55.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e40c97a0 con 0x7ff8e415e370 2024-04-17T14:39:55.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ec800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e406be50 con 0x7ff8e415eea0 2024-04-17T14:39:55.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8e9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8e415e370 0x7ff8e40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ea800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8e40c5310 0x7ff8e40cb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44540/0 (socket says 172.21.15.16:44540) 2024-04-17T14:39:55.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.064+0000 7ff8ea800640 1 -- 172.21.15.16:0/2304517079 learned_addr learned my addr 172.21.15.16:0/2304517079 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:55.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.068+0000 7ff8e9e00640 1 --2- 172.21.15.16:0/2304517079 >> v2:172.21.15.67:3300/0 conn(0x7ff8e415eea0 0x7ff8e4070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.068+0000 7ff8e9400640 1 -- 172.21.15.16:0/2304517079 >> v2:172.21.15.67:3300/0 conn(0x7ff8e415eea0 msgr2=0x7ff8e4070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.068+0000 7ff8e9400640 1 --2- 172.21.15.16:0/2304517079 >> v2:172.21.15.67:3300/0 conn(0x7ff8e415eea0 0x7ff8e4070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.068+0000 7ff8e9400640 1 -- 172.21.15.16:0/2304517079 >> v1:172.21.15.16:6789/0 conn(0x7ff8e40c5310 legacy=0x7ff8e40cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.068+0000 7ff8e9400640 1 -- 172.21.15.16:0/2304517079 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e406c130 con 0x7ff8e415e370 2024-04-17T14:39:55.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.076+0000 7ff8e9400640 1 --2- 172.21.15.16:0/2304517079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415e370 0x7ff8e40ce680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ca460 tx=0x7ff8d401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c760ff9c45215f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:55.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8e8a00640 1 -- 172.21.15.16:0/2304517079 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40b5070 con 0x7ff8e415e370 2024-04-17T14:39:55.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8e8a00640 1 -- 172.21.15.16:0/2304517079 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d40a8970 con 0x7ff8e415e370 2024-04-17T14:39:55.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8e8a00640 1 -- 172.21.15.16:0/2304517079 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40a8d40 con 0x7ff8e415e370 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- 172.21.15.16:0/2304517079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415e370 msgr2=0x7ff8e40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 --2- 172.21.15.16:0/2304517079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415e370 0x7ff8e40ce680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ca460 tx=0x7ff8d401ec70 comp rx=0 tx=0).stop 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- 172.21.15.16:0/2304517079 shutdown_connections 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 --2- 172.21.15.16:0/2304517079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415e370 0x7ff8e40ce680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 --2- 172.21.15.16:0/2304517079 >> v2:172.21.15.67:3300/0 conn(0x7ff8e415eea0 0x7ff8e4070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- 172.21.15.16:0/2304517079 >> 172.21.15.16:0/2304517079 conn(0x7ff8e406dc40 msgr2=0x7ff8e406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- 172.21.15.16:0/2304517079 shutdown_connections 2024-04-17T14:39:55.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- 172.21.15.16:0/2304517079 wait complete. 2024-04-17T14:39:55.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 Processor -- start 2024-04-17T14:39:55.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.080+0000 7ff8ec800640 1 -- start start 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40c5310 0x7ff8e41f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e40b2e20 0x7ff8e40afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e40c9fb0 con 0x7ff8e415eea0 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e40c9cd0 con 0x7ff8e40b2e20 2024-04-17T14:39:55.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ec800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e4070ab0 con 0x7ff8e40c5310 2024-04-17T14:39:55.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8e9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8e9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36764/0 (socket says 172.21.15.16:36764) 2024-04-17T14:39:55.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8e9400640 1 -- 172.21.15.16:0/3538348699 learned_addr learned my addr 172.21.15.16:0/3538348699 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:55.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8ea800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e40b2e20 0x7ff8e40afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.084+0000 7ff8e9e00640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40c5310 0x7ff8e41f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 -- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40c5310 msgr2=0x7ff8e41f0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40c5310 0x7ff8e41f0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 -- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e40b2e20 msgr2=0x7ff8e40afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e40b2e20 0x7ff8e40afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 -- 172.21.15.16:0/3538348699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e41553a0 con 0x7ff8e415eea0 2024-04-17T14:39:55.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.088+0000 7ff8e9400640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8d409b490 tx=0x7ff8d401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.092+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40b5040 con 0x7ff8e415eea0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.092+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d40be070 con 0x7ff8e415eea0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.092+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40b19b0 con 0x7ff8e415eea0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.092+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e40b1db0 con 0x7ff8e415eea0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.092+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e41f4370 con 0x7ff8e415eea0 2024-04-17T14:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.096+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e4076280 con 0x7ff8e415eea0 2024-04-17T14:39:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.364+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8d40b1b50 con 0x7ff8e415eea0 2024-04-17T14:39:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.364+0000 7ff8de000640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 0x7ff8c806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.364+0000 7ff8e9e00640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 0x7ff8c806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.364+0000 7ff8e9e00640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 0x7ff8c806a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009a50 tx=0x7ff8d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:55.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.376+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff8d40fad90 con 0x7ff8e415eea0 2024-04-17T14:39:55.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.376+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff8d40187d0 con 0x7ff8e415eea0 2024-04-17T14:39:55.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.544+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff8e4158890 con 0x7ff8e415eea0 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8de000640 1 -- 172.21.15.16:0/3538348699 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7ff8d40f4bf0 con 0x7ff8e415eea0 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-17T14:39:55.549 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 msgr2=0x7ff8c806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 0x7ff8c806a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009a50 tx=0x7ff8d8008040 comp rx=0 tx=0).stop 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 msgr2=0x7ff8e41f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8d409b490 tx=0x7ff8d401ba10 comp rx=0 tx=0).stop 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 shutdown_connections 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff8c80683d0 0x7ff8c806a890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e40b2e20 0x7ff8e40afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e415eea0 0x7ff8e41f4b70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 --2- 172.21.15.16:0/3538348699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40c5310 0x7ff8e41f0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 >> 172.21.15.16:0/3538348699 conn(0x7ff8e406dc40 msgr2=0x7ff8e4071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 shutdown_connections 2024-04-17T14:39:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.552+0000 7ff8ec800640 1 -- 172.21.15.16:0/3538348699 wait complete. 2024-04-17T14:39:55.570 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T14:39:55.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T14:39:55.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 Processor -- start 2024-04-17T14:39:55.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 -- start start 2024-04-17T14:39:55.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 0x7f97b40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97b40c9f90 0x7f97b4070930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b40c92a0 con 0x7f97b40b0e80 2024-04-17T14:39:55.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f97b415b870 con 0x7f97b40c9f90 2024-04-17T14:39:55.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.716+0000 7f97bc400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f97b415b220 con 0x7f97b415bd00 2024-04-17T14:39:55.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97b9a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f97b40b0e80 0x7f97b4071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44544/0 (socket says 172.21.15.16:44544) 2024-04-17T14:39:55.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97b9a00640 1 -- 172.21.15.16:0/3017709674 learned_addr learned my addr 172.21.15.16:0/3017709674 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:55.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97ba400640 1 --2- 172.21.15.16:0/3017709674 >> v2:172.21.15.67:3300/0 conn(0x7f97b40c9f90 0x7f97b4070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97b9000640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 0x7f97b40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602464467 0 0) 0x7f97b40c92a0 con 0x7f97b40b0e80 2024-04-17T14:39:55.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.720+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f979c003530 con 0x7f97b40b0e80 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2012472886 0 0) 0x7f979c003530 con 0x7f97b40b0e80 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 msgr2=0x7f97b40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 0x7f97b40703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 >> v2:172.21.15.67:3300/0 conn(0x7f97b40c9f90 msgr2=0x7f97b4070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 --2- 172.21.15.16:0/3017709674 >> v2:172.21.15.67:3300/0 conn(0x7f97b40c9f90 0x7f97b4070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b415b500 con 0x7f97b40b0e80 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f97a8001680 con 0x7f97b40b0e80 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 >> v1:172.21.15.16:6789/0 conn(0x7f97b40b0e80 legacy=0x7f97b4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f979c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004810 0x7f979c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 0x7f979c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97b415b870 con 0x7f979c0039c0 2024-04-17T14:39:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97b415b220 con 0x7f979c004810 2024-04-17T14:39:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.724+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f979c00ba20 con 0x7f97b415bd00 2024-04-17T14:39:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.728+0000 7f97b9a00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f979c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.732+0000 7f97b9a00640 1 -- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 msgr2=0x7f979c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.732+0000 7f97b9a00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415bd00 0x7f979c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.732+0000 7f97b9a00640 1 -- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004810 msgr2=0x7f979c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.732+0000 7f97b9a00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f979c004810 0x7f979c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.732+0000 7f97b9a00640 1 -- 172.21.15.16:0/3017709674 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c003530 con 0x7f979c0039c0 2024-04-17T14:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.736+0000 7f97b9a00640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f979c003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c1c0 tx=0x7f97a801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca71bb40b7decbb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8007c70 con 0x7f979c0039c0 2024-04-17T14:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a80a9020 con 0x7f979c0039c0 2024-04-17T14:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97b3e00640 1 -- 172.21.15.16:0/3017709674 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8005ae0 con 0x7f979c0039c0 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 -- 172.21.15.16:0/3017709674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 msgr2=0x7f979c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 --2- 172.21.15.16:0/3017709674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f979c003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c1c0 tx=0x7f97a801cbc0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97ba400640 1 -- 172.21.15.16:0/3017709674 reap_dead start 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 -- 172.21.15.16:0/3017709674 shutdown_connections 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 -- 172.21.15.16:0/3017709674 >> 172.21.15.16:0/3017709674 conn(0x7f97b4062ca0 msgr2=0x7f97b406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 -- 172.21.15.16:0/3017709674 shutdown_connections 2024-04-17T14:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.740+0000 7f97bc400640 1 -- 172.21.15.16:0/3017709674 wait complete. 2024-04-17T14:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 Processor -- start 2024-04-17T14:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 -- start start 2024-04-17T14:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415fa50 0x7f97b40aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b4158d20 0x7f97b40af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97b4166260 con 0x7f979c0039c0 2024-04-17T14:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97b41660e0 con 0x7f97b4158d20 2024-04-17T14:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97bc400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f97b41663e0 con 0x7f97b415fa50 2024-04-17T14:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97b9a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97b9a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36780/0 (socket says 172.21.15.16:36780) 2024-04-17T14:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97b9a00640 1 -- 172.21.15.16:0/910862778 learned_addr learned my addr 172.21.15.16:0/910862778 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97ba400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b4158d20 0x7f97b40af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.744+0000 7f97b9000640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415fa50 0x7f97b40aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.752+0000 7f97b9a00640 1 -- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415fa50 msgr2=0x7f97b40aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.752+0000 7f97b9a00640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415fa50 0x7f97b40aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.752+0000 7f97b9a00640 1 -- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b4158d20 msgr2=0x7f97b40af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.752+0000 7f97b9a00640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b4158d20 0x7f97b40af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.752+0000 7f97b9a00640 1 -- 172.21.15.16:0/910862778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b41609a0 con 0x7f979c0039c0 2024-04-17T14:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.756+0000 7f97b9a00640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97a8007040 tx=0x7f979c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.760+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a80049f0 con 0x7f979c0039c0 2024-04-17T14:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.760+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a8004b90 con 0x7f979c0039c0 2024-04-17T14:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.760+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a80070d0 con 0x7f979c0039c0 2024-04-17T14:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.760+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b4160c50 con 0x7f979c0039c0 2024-04-17T14:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.760+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b4161210 con 0x7f979c0039c0 2024-04-17T14:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:55.764+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b4076280 con 0x7f979c0039c0 2024-04-17T14:39:56.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.028+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97a8007270 con 0x7f979c0039c0 2024-04-17T14:39:56.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.028+0000 7f97b1600640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 0x7f979406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:56.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.028+0000 7f97b9000640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 0x7f979406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:56.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.032+0000 7f97b9000640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 0x7f979406a890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97b415fe50 tx=0x7f97a00094c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:56.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.044+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f97a80f69a0 con 0x7f979c0039c0 2024-04-17T14:39:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.044+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f97a80c7080 con 0x7f979c0039c0 2024-04-17T14:39:56.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:56.212+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f97b4070fc0 con 0x7f979c0039c0 2024-04-17T14:39:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.108+0000 7f97b1600640 1 -- 172.21.15.16:0/910862778 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f97a80168d0 con 0x7f979c0039c0 2024-04-17T14:39:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-17T14:39:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 msgr2=0x7f979406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 0x7f979406a890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97b415fe50 tx=0x7f97a00094c0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 msgr2=0x7f97b4156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97a8007040 tx=0x7f979c005840 comp rx=0 tx=0).stop 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 shutdown_connections 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f97940683d0 0x7f979406a890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b4158d20 0x7f97b40af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f97b415fa50 0x7f97b40aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 --2- 172.21.15.16:0/910862778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f979c0039c0 0x7f97b4156450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 >> 172.21.15.16:0/910862778 conn(0x7f97b4062ca0 msgr2=0x7f97b40ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 shutdown_connections 2024-04-17T14:39:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.112+0000 7f97bc400640 1 -- 172.21.15.16:0/910862778 wait complete. 2024-04-17T14:39:57.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T14:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.284+0000 7f1af6600640 1 Processor -- start 2024-04-17T14:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.284+0000 7f1af6600640 1 -- start start 2024-04-17T14:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1af6600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1af0151890 0x7f1af00c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1af6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 0x7f1af01621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1af6600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1af0072200 con 0x7f1af00c6470 2024-04-17T14:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1af6600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1af00c7230 con 0x7f1af0151890 2024-04-17T14:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1af6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1af0157870 con 0x7f1af0151c70 2024-04-17T14:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1ae7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1af00c6470 0x7f1af00cc720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44550/0 (socket says 172.21.15.16:44550) 2024-04-17T14:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1ae7e00640 1 -- 172.21.15.16:0/308551708 learned_addr learned my addr 172.21.15.16:0/308551708 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438288914 0 0) 0x7f1af0072200 con 0x7f1af00c6470 2024-04-17T14:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.288+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ad4005740 con 0x7f1af00c6470 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3974958022 0 0) 0x7f1ad4005740 con 0x7f1af00c6470 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 msgr2=0x7f1af01621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 0x7f1af01621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 >> v2:172.21.15.67:3300/0 conn(0x7f1af0151890 msgr2=0x7f1af00c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 --2- 172.21.15.16:0/308551708 >> v2:172.21.15.67:3300/0 conn(0x7f1af0151890 0x7f1af00c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af00724c0 con 0x7f1af00c6470 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f1ad8001680 con 0x7f1af00c6470 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 >> v1:172.21.15.16:6789/0 conn(0x7f1af00c6470 legacy=0x7f1af00cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 0x7f1ad4005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ad4006330 0x7f1ad4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad4007080 0x7f1ad400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1af00c7230 con 0x7f1ad4007080 2024-04-17T14:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1af0157870 con 0x7f1ad4006330 2024-04-17T14:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.292+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad400e120 con 0x7f1af0151c70 2024-04-17T14:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.296+0000 7f1af5c00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad4007080 0x7f1ad400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.300+0000 7f1af5c00640 1 -- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 msgr2=0x7f1ad4005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.300+0000 7f1af5c00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0151c70 0x7f1ad4005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.300+0000 7f1af5c00640 1 -- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ad4006330 msgr2=0x7f1ad4006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.300+0000 7f1af5c00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ad4006330 0x7f1ad4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.300+0000 7f1af5c00640 1 -- 172.21.15.16:0/308551708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad4005740 con 0x7f1ad4007080 2024-04-17T14:39:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.304+0000 7f1af5c00640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad4007080 0x7f1ad400dbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009ca0 tx=0x7f1ae801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ba0462ae075850 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80b2070 con 0x7f1ad4007080 2024-04-17T14:39:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae80a5ca0 con 0x7f1ad4007080 2024-04-17T14:39:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1aefe00640 1 -- 172.21.15.16:0/308551708 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8006e60 con 0x7f1ad4007080 2024-04-17T14:39:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 -- 172.21.15.16:0/308551708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad4007080 msgr2=0x7f1ad400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 --2- 172.21.15.16:0/308551708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad4007080 0x7f1ad400dbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009ca0 tx=0x7f1ae801cc70 comp rx=0 tx=0).stop 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af5c00640 1 -- 172.21.15.16:0/308551708 reap_dead start 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 -- 172.21.15.16:0/308551708 shutdown_connections 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 -- 172.21.15.16:0/308551708 >> 172.21.15.16:0/308551708 conn(0x7f1af006be30 msgr2=0x7f1af006c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 -- 172.21.15.16:0/308551708 shutdown_connections 2024-04-17T14:39:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 -- 172.21.15.16:0/308551708 wait complete. 2024-04-17T14:39:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.308+0000 7f1af6600640 1 Processor -- start 2024-04-17T14:39:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 -- start start 2024-04-17T14:39:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ad4007080 0x7f1af01e1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af01ef520 0x7f1af01ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1af0072940 con 0x7f1af014b6d0 2024-04-17T14:39:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1af00c3b50 con 0x7f1af01ef520 2024-04-17T14:39:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1af6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1af0072ac0 con 0x7f1ad4007080 2024-04-17T14:39:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1ae7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1ae7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36790/0 (socket says 172.21.15.16:36790) 2024-04-17T14:39:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.312+0000 7f1ae7e00640 1 -- 172.21.15.16:0/4255373056 learned_addr learned my addr 172.21.15.16:0/4255373056 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:57.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.316+0000 7f1ae7e00640 1 -- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ad4007080 msgr2=0x7f1af01e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.316+0000 7f1ae7e00640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ad4007080 0x7f1af01e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.316+0000 7f1ae7e00640 1 -- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af01ef520 msgr2=0x7f1af01ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:57.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.316+0000 7f1ae7e00640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af01ef520 0x7f1af01ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:57.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.316+0000 7f1ae7e00640 1 -- 172.21.15.16:0/4255373056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af01ec2c0 con 0x7f1af014b6d0 2024-04-17T14:39:57.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.320+0000 7f1ae7e00640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800f560 tx=0x7f1ad800fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:57.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad801b070 con 0x7f1af014b6d0 2024-04-17T14:39:57.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad8007d40 con 0x7f1af014b6d0 2024-04-17T14:39:57.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af0148e50 con 0x7f1af014b6d0 2024-04-17T14:39:57.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800a390 con 0x7f1af014b6d0 2024-04-17T14:39:57.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af0149410 con 0x7f1af014b6d0 2024-04-17T14:39:57.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.324+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af00761a0 con 0x7f1af014b6d0 2024-04-17T14:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.344+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ad801e070 con 0x7f1af014b6d0 2024-04-17T14:39:57.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.348+0000 7f1aed600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 0x7f1acc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.348+0000 7f1af5200640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 0x7f1acc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:57.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.348+0000 7f1af5200640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 0x7f1acc06a8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00096b0 tx=0x7f1ae0006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:57.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.616+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f1ad8057490 con 0x7f1af014b6d0 2024-04-17T14:39:57.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.616+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1ad80593f0 con 0x7f1af014b6d0 2024-04-17T14:39:57.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:57.791+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1af0155550 con 0x7f1af014b6d0 2024-04-17T14:39:58.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.223+0000 7f1aed600640 1 -- 172.21.15.16:0/4255373056 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f1ad805d6f0 con 0x7f1af014b6d0 2024-04-17T14:39:58.224 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-17T14:39:58.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 msgr2=0x7f1acc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 0x7f1acc06a8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00096b0 tx=0x7f1ae0006ca0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 msgr2=0x7f1af0149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800f560 tx=0x7f1ad800fa20 comp rx=0 tx=0).stop 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 shutdown_connections 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1acc068400 0x7f1acc06a8c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af01ef520 0x7f1af01ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af014b6d0 0x7f1af0149c10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 --2- 172.21.15.16:0/4255373056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ad4007080 0x7f1af01e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 >> 172.21.15.16:0/4255373056 conn(0x7f1af006be30 msgr2=0x7f1af00c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 shutdown_connections 2024-04-17T14:39:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.227+0000 7f1af6600640 1 -- 172.21.15.16:0/4255373056 wait complete. 2024-04-17T14:39:58.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T14:39:58.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.403+0000 7fa965000640 1 Processor -- start 2024-04-17T14:39:58.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.403+0000 7fa965000640 1 -- start start 2024-04-17T14:39:58.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa965000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa96015be40 0x7fa9600c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa965000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa960158610 con 0x7fa9600c5a20 2024-04-17T14:39:58.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa965000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9601588f0 con 0x7fa960151db0 2024-04-17T14:39:58.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa965000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa9600c8be0 con 0x7fa96015be40 2024-04-17T14:39:58.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa95e800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa9600c5a20 0x7fa9600c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44562/0 (socket says 172.21.15.16:44562) 2024-04-17T14:39:58.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.407+0000 7fa95e800640 1 -- 172.21.15.16:0/1689393651 learned_addr learned my addr 172.21.15.16:0/1689393651 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:39:58.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.411+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292079435 0 0) 0x7fa960158610 con 0x7fa9600c5a20 2024-04-17T14:39:58.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.411+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa944003530 con 0x7fa9600c5a20 2024-04-17T14:39:58.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077614259 0 0) 0x7fa944003530 con 0x7fa9600c5a20 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 >> v2:172.21.15.67:3300/0 conn(0x7fa96015be40 msgr2=0x7fa9600c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 --2- 172.21.15.16:0/1689393651 >> v2:172.21.15.67:3300/0 conn(0x7fa96015be40 0x7fa9600c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 >> v1:172.21.15.67:6789/0 conn(0x7fa960151db0 legacy=0x7fa960157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96015b360 con 0x7fa9600c5a20 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fa958001a00 con 0x7fa9600c5a20 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 >> v1:172.21.15.16:6789/0 conn(0x7fa9600c5a20 legacy=0x7fa9600c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 0x7fa944003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944004810 0x7fa944004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9440052f0 0x7fa94400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa94400c200 con 0x7fa944003a10 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa94400c3b0 con 0x7fa9440052f0 2024-04-17T14:39:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa94400c5b0 con 0x7fa944004810 2024-04-17T14:39:58.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.415+0000 7fa95de00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 0x7fa944003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:58.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95de00640 1 -- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944004810 msgr2=0x7fa944004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:58.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95de00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944004810 0x7fa944004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95de00640 1 -- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9440052f0 msgr2=0x7fa94400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:58.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95de00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9440052f0 0x7fa94400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95de00640 1 -- 172.21.15.16:0/1689393651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa944003530 con 0x7fa944003a10 2024-04-17T14:39:58.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.419+0000 7fa95e800640 1 -- 172.21.15.16:0/1689393651 reap_dead start 2024-04-17T14:39:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.439+0000 7fa95de00640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 0x7fa944003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa950007fd0 tx=0x7fa95001c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6abc78394c3b542 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950001250 con 0x7fa944003a10 2024-04-17T14:39:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950005270 con 0x7fa944003a10 2024-04-17T14:39:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa95ca00640 1 -- 172.21.15.16:0/1689393651 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950003860 con 0x7fa944003a10 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 msgr2=0x7fa944003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 0x7fa944003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa950007fd0 tx=0x7fa95001c2c0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- 172.21.15.16:0/1689393651 shutdown_connections 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 --2- 172.21.15.16:0/1689393651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa944003a10 0x7fa944003e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- 172.21.15.16:0/1689393651 >> 172.21.15.16:0/1689393651 conn(0x7fa96006ba30 msgr2=0x7fa96006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- 172.21.15.16:0/1689393651 shutdown_connections 2024-04-17T14:39:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- 172.21.15.16:0/1689393651 wait complete. 2024-04-17T14:39:58.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 Processor -- start 2024-04-17T14:39:58.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.447+0000 7fa965000640 1 -- start start 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944003a10 0x7fa960148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96015a4d0 0x7fa96014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa96015b920 con 0x7fa96014f670 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa960071b30 con 0x7fa96015a4d0 2024-04-17T14:39:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa965000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa960152190 con 0x7fa944003a10 2024-04-17T14:39:58.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa95d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:58.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa95d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36800/0 (socket says 172.21.15.16:36800) 2024-04-17T14:39:58.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.451+0000 7fa95d400640 1 -- 172.21.15.16:0/1040431652 learned_addr learned my addr 172.21.15.16:0/1040431652 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.455+0000 7fa95d400640 1 -- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944003a10 msgr2=0x7fa960148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.455+0000 7fa95d400640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944003a10 0x7fa960148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.455+0000 7fa95d400640 1 -- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96015a4d0 msgr2=0x7fa96014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.455+0000 7fa95d400640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96015a4d0 0x7fa96014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.455+0000 7fa95d400640 1 -- 172.21.15.16:0/1040431652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96014df60 con 0x7fa96014f670 2024-04-17T14:39:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.459+0000 7fa95d400640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00b400 tx=0x7fa94c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:58.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c015020 con 0x7fa96014f670 2024-04-17T14:39:58.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94c011830 con 0x7fa96014f670 2024-04-17T14:39:58.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c011c00 con 0x7fa96014f670 2024-04-17T14:39:58.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96015ab90 con 0x7fa96014f670 2024-04-17T14:39:58.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa960155ea0 con 0x7fa96014f670 2024-04-17T14:39:58.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.463+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa960076280 con 0x7fa96014f670 2024-04-17T14:39:58.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.483+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa94c018020 con 0x7fa96014f670 2024-04-17T14:39:58.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.483+0000 7fa956000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:58.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.483+0000 7fa95de00640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:58.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.487+0000 7fa95de00640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9500aa000 tx=0x7fa950000fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:58.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.747+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fa94c054e20 con 0x7fa96014f670 2024-04-17T14:39:58.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.747+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa94c01f020 con 0x7fa96014f670 2024-04-17T14:39:58.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:58.959+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa960072f30 con 0x7fa96014f670 2024-04-17T14:39:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa956000640 1 -- 172.21.15.16:0/1040431652 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa94c00f2e0 con 0x7fa96014f670 2024-04-17T14:39:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 msgr2=0x7fa94006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9500aa000 tx=0x7fa950000fc0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 msgr2=0x7fa9601f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00b400 tx=0x7fa94c00b8c0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 shutdown_connections 2024-04-17T14:39:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96015a4d0 0x7fa96014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa96014f670 0x7fa9601f0990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 --2- 172.21.15.16:0/1040431652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa944003a10 0x7fa960148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 >> 172.21.15.16:0/1040431652 conn(0x7fa96006ba30 msgr2=0x7fa960073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 shutdown_connections 2024-04-17T14:39:59.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.555+0000 7fa965000640 1 -- 172.21.15.16:0/1040431652 wait complete. 2024-04-17T14:39:59.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:39:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 Processor -- start 2024-04-17T14:39:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 -- start start 2024-04-17T14:39:59.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f0152b30 0x7f18f015c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18f00c75f0 0x7f18f00c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f18f00ccb00 0x7f18f00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f18f015ce40 con 0x7f18f00c75f0 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f18f0158ba0 con 0x7f18f00ccb00 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18efe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f18f0158e80 con 0x7f18f0152b30 2024-04-17T14:39:59.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18e7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18f00c75f0 0x7f18f00c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:59.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18e7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18f00c75f0 0x7f18f00c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36808/0 (socket says 172.21.15.16:36808) 2024-04-17T14:39:59.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18e7e00640 1 -- 172.21.15.16:0/1934648110 learned_addr learned my addr 172.21.15.16:0/1934648110 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:59.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.719+0000 7f18eea00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f0152b30 0x7f18f015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.723+0000 7f18e7e00640 1 -- 172.21.15.16:0/1934648110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f0152b30 msgr2=0x7f18f015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.723+0000 7f18e7e00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f0152b30 0x7f18f015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.723+0000 7f18e7e00640 1 -- 172.21.15.16:0/1934648110 >> v2:172.21.15.67:3300/0 conn(0x7f18f00ccb00 msgr2=0x7f18f00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:39:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.723+0000 7f18e7e00640 1 --2- 172.21.15.16:0/1934648110 >> v2:172.21.15.67:3300/0 conn(0x7f18f00ccb00 0x7f18f00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.723+0000 7f18e7e00640 1 -- 172.21.15.16:0/1934648110 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f0159160 con 0x7f18f00c75f0 2024-04-17T14:39:59.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.727+0000 7f18e7e00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f00c75f0 0x7f18f00c7a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18f0075ca0 tx=0x7f18d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadce8d6cf04c423 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:59.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18ee000640 1 -- 172.21.15.16:0/1934648110 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80b0070 con 0x7f18f00c75f0 2024-04-17T14:39:59.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18ee000640 1 -- 172.21.15.16:0/1934648110 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d80ab600 con 0x7f18f00c75f0 2024-04-17T14:39:59.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18ee000640 1 -- 172.21.15.16:0/1934648110 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80ab9d0 con 0x7f18f00c75f0 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 -- 172.21.15.16:0/1934648110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f00c75f0 msgr2=0x7f18f00c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f00c75f0 0x7f18f00c7a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18f0075ca0 tx=0x7f18d801c520 comp rx=0 tx=0).stop 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 -- 172.21.15.16:0/1934648110 shutdown_connections 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 --2- 172.21.15.16:0/1934648110 >> v2:172.21.15.67:3300/0 conn(0x7f18f00ccb00 0x7f18f00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f00c75f0 0x7f18f00c7a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 --2- 172.21.15.16:0/1934648110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f0152b30 0x7f18f015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 -- 172.21.15.16:0/1934648110 >> 172.21.15.16:0/1934648110 conn(0x7f18f006dc20 msgr2=0x7f18f006e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 -- 172.21.15.16:0/1934648110 shutdown_connections 2024-04-17T14:39:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.731+0000 7f18efe00640 1 -- 172.21.15.16:0/1934648110 wait complete. 2024-04-17T14:39:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 Processor -- start 2024-04-17T14:39:59.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 -- start start 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18f00c75f0 0x7f18f014c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f00ccb00 0x7f18f00c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18f00c4bf0 con 0x7f18f0152b30 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18f00c4a70 con 0x7f18f00c75f0 2024-04-17T14:39:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18efe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f18f00c4d70 con 0x7f18f00ccb00 2024-04-17T14:39:59.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18ef400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:59.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18ef400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36810/0 (socket says 172.21.15.16:36810) 2024-04-17T14:39:59.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18ef400640 1 -- 172.21.15.16:0/3439629077 learned_addr learned my addr 172.21.15.16:0/3439629077 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:39:59.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.735+0000 7f18e7e00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f00ccb00 0x7f18f00c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:39:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.739+0000 7f18ef400640 1 -- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f00ccb00 msgr2=0x7f18f00c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.739+0000 7f18ef400640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f00ccb00 0x7f18f00c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.739+0000 7f18ef400640 1 -- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18f00c75f0 msgr2=0x7f18f014c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:39:59.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.739+0000 7f18ef400640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18f00c75f0 0x7f18f014c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:39:59.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.739+0000 7f18ef400640 1 -- 172.21.15.16:0/3439629077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f00c9840 con 0x7f18f0152b30 2024-04-17T14:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.743+0000 7f18ef400640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18e800b9a0 tx=0x7f18e800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:39:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.743+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8019070 con 0x7f18f0152b30 2024-04-17T14:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.743+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f01f3d30 con 0x7f18f0152b30 2024-04-17T14:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.743+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f01f42d0 con 0x7f18f0152b30 2024-04-17T14:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.743+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f00761a0 con 0x7f18f0152b30 2024-04-17T14:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.747+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e800cba0 con 0x7f18f0152b30 2024-04-17T14:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:39:59.747+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8023060 con 0x7f18f0152b30 2024-04-17T14:40:00.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.015+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18e801c070 con 0x7f18f0152b30 2024-04-17T14:40:00.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.015+0000 7f18e6a00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 0x7f18cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.019+0000 7f18eea00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 0x7f18cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.019+0000 7f18eea00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 0x7f18cc06a870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f18e0006aa0 tx=0x7f18e0006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:00.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.031+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f18e8054e10 con 0x7f18f0152b30 2024-04-17T14:40:00.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.031+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f18e8056d70 con 0x7f18f0152b30 2024-04-17T14:40:00.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.219+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18f0074fd0 con 0x7f18f0152b30 2024-04-17T14:40:00.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18e6a00640 1 -- 172.21.15.16:0/3439629077 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16574 (secure 0 0 0) 0x7f18e805b070 con 0x7f18f0152b30 2024-04-17T14:40:00.457 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:00.457 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:39:58.996385+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 msgr2=0x7f18cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 0x7f18cc06a870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f18e0006aa0 tx=0x7f18e0006a30 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 msgr2=0x7f18f00c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18e800b9a0 tx=0x7f18e800be60 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 shutdown_connections 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18cc0683b0 0x7f18cc06a870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18f0152b30 0x7f18f00c9300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f18f00ccb00 0x7f18f00c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 --2- 172.21.15.16:0/3439629077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18f00c75f0 0x7f18f014c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 >> 172.21.15.16:0/3439629077 conn(0x7f18f006dc20 msgr2=0x7f18f0161d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 shutdown_connections 2024-04-17T14:40:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.459+0000 7f18efe00640 1 -- 172.21.15.16:0/3439629077 wait complete. 2024-04-17T14:40:00.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:00.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 Processor -- start 2024-04-17T14:40:00.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 -- start start 2024-04-17T14:40:00.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33c40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c4158610 con 0x7f33c415be40 2024-04-17T14:40:00.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c41588f0 con 0x7f33c4151db0 2024-04-17T14:40:00.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33c8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f33c40c8be0 con 0x7f33c40c5a20 2024-04-17T14:40:00.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33b9400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f33c415be40 0x7f33c40c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44574/0 (socket says 172.21.15.16:44574) 2024-04-17T14:40:00.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.619+0000 7f33b9400640 1 -- 172.21.15.16:0/1722295013 learned_addr learned my addr 172.21.15.16:0/1722295013 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:00.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.623+0000 7f33c2800640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33c40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.623+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88082921 0 0) 0x7f33c4158610 con 0x7f33c415be40 2024-04-17T14:40:00.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.623+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a8003530 con 0x7f33c415be40 2024-04-17T14:40:00.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 918378618 0 0) 0x7f33a8003530 con 0x7f33c415be40 2024-04-17T14:40:00.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 msgr2=0x7f33c40c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:00.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33c40c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 >> v1:172.21.15.67:6789/0 conn(0x7f33c4151db0 legacy=0x7f33c4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c415b360 con 0x7f33c415be40 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f33ac001680 con 0x7f33c415be40 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 >> v1:172.21.15.16:6789/0 conn(0x7f33c415be40 legacy=0x7f33c40c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33a80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a8003fa0 0x7f33a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33a800dd80 con 0x7f33a8004d50 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33a800df30 con 0x7f33a8003fa0 2024-04-17T14:40:00.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.627+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f33a800e130 con 0x7f33c40c5a20 2024-04-17T14:40:00.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.631+0000 7f33c2800640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c1e00640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33a80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c2800640 1 -- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 msgr2=0x7f33a80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c2800640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40c5a20 0x7f33a80039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c2800640 1 -- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a8003fa0 msgr2=0x7f33a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c2800640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33a8003fa0 0x7f33a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.635+0000 7f33c2800640 1 -- 172.21.15.16:0/1722295013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a8003530 con 0x7f33a8004d50 2024-04-17T14:40:00.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.639+0000 7f33c2800640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33a80051d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009fc0 tx=0x7f33bc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3ee49e432eb529 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:00.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0b2070 con 0x7f33a8004d50 2024-04-17T14:40:00.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a5c90 con 0x7f33a8004d50 2024-04-17T14:40:00.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c1400640 1 -- 172.21.15.16:0/1722295013 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc009c10 con 0x7f33a8004d50 2024-04-17T14:40:00.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- 172.21.15.16:0/1722295013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 msgr2=0x7f33a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 --2- 172.21.15.16:0/1722295013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33a80051d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009fc0 tx=0x7f33bc01cc80 comp rx=0 tx=0).stop 2024-04-17T14:40:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c2800640 1 -- 172.21.15.16:0/1722295013 reap_dead start 2024-04-17T14:40:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- 172.21.15.16:0/1722295013 shutdown_connections 2024-04-17T14:40:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- 172.21.15.16:0/1722295013 >> 172.21.15.16:0/1722295013 conn(0x7f33c406ba30 msgr2=0x7f33c406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- 172.21.15.16:0/1722295013 shutdown_connections 2024-04-17T14:40:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- 172.21.15.16:0/1722295013 wait complete. 2024-04-17T14:40:00.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 Processor -- start 2024-04-17T14:40:00.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- start start 2024-04-17T14:40:00.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40ca270 0x7f33c415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c41f03d0 0x7f33c4147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33c415b920 con 0x7f33a8004d50 2024-04-17T14:40:00.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4071b30 con 0x7f33c41f03d0 2024-04-17T14:40:00.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.643+0000 7f33c8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f33c41582e0 con 0x7f33c40ca270 2024-04-17T14:40:00.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.647+0000 7f33c1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.647+0000 7f33c1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36832/0 (socket says 172.21.15.16:36832) 2024-04-17T14:40:00.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.647+0000 7f33c1e00640 1 -- 172.21.15.16:0/981740659 learned_addr learned my addr 172.21.15.16:0/981740659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 -- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40ca270 msgr2=0x7f33c415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40ca270 0x7f33c415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 -- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c41f03d0 msgr2=0x7f33c4147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c41f03d0 0x7f33c4147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:00.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 -- 172.21.15.16:0/981740659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c414b4e0 con 0x7f33a8004d50 2024-04-17T14:40:00.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.651+0000 7f33c1e00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33b400d530 tx=0x7f33b400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:00.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4005480 con 0x7f33a8004d50 2024-04-17T14:40:00.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c414b7c0 con 0x7f33a8004d50 2024-04-17T14:40:00.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c41ec560 con 0x7f33a8004d50 2024-04-17T14:40:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c4076280 con 0x7f33a8004d50 2024-04-17T14:40:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4017070 con 0x7f33a8004d50 2024-04-17T14:40:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.655+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4003800 con 0x7f33a8004d50 2024-04-17T14:40:00.707 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:40:00.710 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:40:00.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.927+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33b40039a0 con 0x7f33a8004d50 2024-04-17T14:40:00.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.927+0000 7f33baa00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 0x7f33a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:00.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.931+0000 7f33b9400640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 0x7f33a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:00.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.931+0000 7f33b9400640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 0x7f33a006a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33c4150400 tx=0x7f33ac001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:00.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.939+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33b4055110 con 0x7f33a8004d50 2024-04-17T14:40:00.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:00.943+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f33b4057770 con 0x7f33a8004d50 2024-04-17T14:40:01.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.135+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33c40c4400 con 0x7f33a8004d50 2024-04-17T14:40:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.175+0000 7f33baa00640 1 -- 172.21.15.16:0/981740659 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16561 (secure 0 0 0) 0x7f33b4057070 con 0x7f33a8004d50 2024-04-17T14:40:01.176 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:01.176 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:00.289514+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 msgr2=0x7f33a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 0x7f33a006a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33c4150400 tx=0x7f33ac001610 comp rx=0 tx=0).stop 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 msgr2=0x7f33c41ecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33b400d530 tx=0x7f33b400d9f0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 shutdown_connections 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f33a0068380 0x7f33a006a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c41f03d0 0x7f33c4147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f33c40ca270 0x7f33c415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 --2- 172.21.15.16:0/981740659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33a8004d50 0x7f33c41ecd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 >> 172.21.15.16:0/981740659 conn(0x7f33c406ba30 msgr2=0x7f33c414f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 shutdown_connections 2024-04-17T14:40:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.179+0000 7f33c8a00640 1 -- 172.21.15.16:0/981740659 wait complete. 2024-04-17T14:40:01.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T14:40:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 Processor -- start 2024-04-17T14:40:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 -- start start 2024-04-17T14:40:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc1c0c9cd0 0x7fdc1c0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c15b8e0 con 0x7fdc1c154f80 2024-04-17T14:40:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c15bbc0 con 0x7fdc1c0caef0 2024-04-17T14:40:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc23e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1c0c8f10 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc20a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc1c0c9cd0 0x7fdc1c0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc21400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdc1c154f80 0x7fdc1c0c3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35630/0 (socket says 172.21.15.16:35630) 2024-04-17T14:40:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.343+0000 7fdc21400640 1 -- 172.21.15.16:0/1498651104 learned_addr learned my addr 172.21.15.16:0/1498651104 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.347+0000 7fdc20a00640 1 -- 172.21.15.16:0/1498651104 >> v1:172.21.15.67:6789/0 conn(0x7fdc1c0caef0 legacy=0x7fdc1c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.347+0000 7fdc20a00640 1 -- 172.21.15.16:0/1498651104 >> v1:172.21.15.16:6789/0 conn(0x7fdc1c154f80 legacy=0x7fdc1c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.347+0000 7fdc20a00640 1 -- 172.21.15.16:0/1498651104 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0c91f0 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.355+0000 7fdc20a00640 1 --2- 172.21.15.16:0/1498651104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c0aebc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097c0 tx=0x7fdc0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9476bae92bf9a62e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:01.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc1be00640 1 -- 172.21.15.16:0/1498651104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080b0070 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc1be00640 1 -- 172.21.15.16:0/1498651104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080ab600 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc1be00640 1 -- 172.21.15.16:0/1498651104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080ab9d0 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- 172.21.15.16:0/1498651104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0c9cd0 msgr2=0x7fdc1c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1498651104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c0aebc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097c0 tx=0x7fdc0801c4a0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- 172.21.15.16:0/1498651104 shutdown_connections 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1498651104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c0aebc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- 172.21.15.16:0/1498651104 >> 172.21.15.16:0/1498651104 conn(0x7fdc1c0716a0 msgr2=0x7fdc1c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- 172.21.15.16:0/1498651104 shutdown_connections 2024-04-17T14:40:01.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- 172.21.15.16:0/1498651104 wait complete. 2024-04-17T14:40:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 Processor -- start 2024-04-17T14:40:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- start start 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc1c154f80 0x7fdc1c1f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1554e0 con 0x7fdc1c0caef0 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c155360 con 0x7fdc1c0c9cd0 2024-04-17T14:40:01.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.359+0000 7fdc23e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1c15b460 con 0x7fdc1c154f80 2024-04-17T14:40:01.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.363+0000 7fdc20a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:01.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.363+0000 7fdc20a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47822/0 (socket says 172.21.15.16:47822) 2024-04-17T14:40:01.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.363+0000 7fdc20a00640 1 -- 172.21.15.16:0/1540578447 learned_addr learned my addr 172.21.15.16:0/1540578447 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:01.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.363+0000 7fdc21400640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:01.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.363+0000 7fdc21e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc1c154f80 0x7fdc1c1f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 -- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc1c154f80 msgr2=0x7fdc1c1f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc1c154f80 0x7fdc1c1f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 -- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc1c0c9cd0 msgr2=0x7fdc1c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 -- 172.21.15.16:0/1540578447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c157410 con 0x7fdc1c0caef0 2024-04-17T14:40:01.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.367+0000 7fdc20a00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc080190b0 tx=0x7fdc08019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:01.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080b0040 con 0x7fdc1c0caef0 2024-04-17T14:40:01.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080b4410 con 0x7fdc1c0caef0 2024-04-17T14:40:01.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080b4800 con 0x7fdc1c0caef0 2024-04-17T14:40:01.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1c1581b0 con 0x7fdc1c0caef0 2024-04-17T14:40:01.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1c156930 con 0x7fdc1c0caef0 2024-04-17T14:40:01.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.371+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1c076280 con 0x7fdc1c0caef0 2024-04-17T14:40:01.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.395+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc080bc020 con 0x7fdc1c0caef0 2024-04-17T14:40:01.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.395+0000 7fdc19600640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 0x7fdbfc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:01.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.395+0000 7fdc21400640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 0x7fdbfc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.395+0000 7fdc21400640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 0x7fdbfc06a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005890 tx=0x7fdc10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:01.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.655+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdc080eec00 con 0x7fdc1c0caef0 2024-04-17T14:40:01.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.655+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdc08016090 con 0x7fdc1c0caef0 2024-04-17T14:40:01.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:01.855+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdc1c0cacd0 con 0x7fdc1c0caef0 2024-04-17T14:40:02.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc19600640 1 -- 172.21.15.16:0/1540578447 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fdc080f0b60 con 0x7fdc1c0caef0 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 msgr2=0x7fdbfc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 0x7fdbfc06a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005890 tx=0x7fdc10009040 comp rx=0 tx=0).stop 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 msgr2=0x7fdc1c1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc080190b0 tx=0x7fdc08019240 comp rx=0 tx=0).stop 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 shutdown_connections 2024-04-17T14:40:02.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdbfc068400 0x7fdbfc06a8c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc1c154f80 0x7fdc1c1f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1c0caef0 0x7fdc1c1558c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 --2- 172.21.15.16:0/1540578447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc1c0c9cd0 0x7fdc1c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 >> 172.21.15.16:0/1540578447 conn(0x7fdc1c0716a0 msgr2=0x7fdc1c153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 shutdown_connections 2024-04-17T14:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.207+0000 7fdc23e00640 1 -- 172.21.15.16:0/1540578447 wait complete. 2024-04-17T14:40:02.228 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-17T14:40:02.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T14:40:02.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 Processor -- start 2024-04-17T14:40:02.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 -- start start 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febd80c9120 0x7febd806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febd8070400 0x7febd806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7febd8070910 con 0x7febd80c9120 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7febd8070bd0 con 0x7febd8070400 2024-04-17T14:40:02.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febe0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7febd8070eb0 con 0x7febd80c9e60 2024-04-17T14:40:02.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febdd400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febd80c9120 0x7febd806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febdd400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febd80c9120 0x7febd806ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47838/0 (socket says 172.21.15.16:47838) 2024-04-17T14:40:02.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febdd400640 1 -- 172.21.15.16:0/3538272013 learned_addr learned my addr 172.21.15.16:0/3538272013 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:02.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febde800640 1 --2- 172.21.15.16:0/3538272013 >> v2:172.21.15.67:3300/0 conn(0x7febd8070400 0x7febd806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.375+0000 7febdde00640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.379+0000 7febdd400640 1 -- 172.21.15.16:0/3538272013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 msgr2=0x7febd80713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:02.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.379+0000 7febdd400640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.379+0000 7febdd400640 1 -- 172.21.15.16:0/3538272013 >> v2:172.21.15.67:3300/0 conn(0x7febd8070400 msgr2=0x7febd806bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:02.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.379+0000 7febdd400640 1 --2- 172.21.15.16:0/3538272013 >> v2:172.21.15.67:3300/0 conn(0x7febd8070400 0x7febd806bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.379+0000 7febdd400640 1 -- 172.21.15.16:0/3538272013 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd815b2a0 con 0x7febd80c9120 2024-04-17T14:40:02.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.383+0000 7febdd400640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd80c9120 0x7febd806ba30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febd8070360 tx=0x7febc801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63084193d9f31cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:02.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febdca00640 1 -- 172.21.15.16:0/3538272013 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80b5070 con 0x7febd80c9120 2024-04-17T14:40:02.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febdca00640 1 -- 172.21.15.16:0/3538272013 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80a89d0 con 0x7febd80c9120 2024-04-17T14:40:02.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febdca00640 1 -- 172.21.15.16:0/3538272013 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80a8da0 con 0x7febd80c9120 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- 172.21.15.16:0/3538272013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd80c9120 msgr2=0x7febd806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd80c9120 0x7febd806ba30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febd8070360 tx=0x7febc801ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- 172.21.15.16:0/3538272013 shutdown_connections 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 --2- 172.21.15.16:0/3538272013 >> v2:172.21.15.67:3300/0 conn(0x7febd8070400 0x7febd806bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd80c9120 0x7febd806ba30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 --2- 172.21.15.16:0/3538272013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- 172.21.15.16:0/3538272013 >> 172.21.15.16:0/3538272013 conn(0x7febd806dc40 msgr2=0x7febd806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:02.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- 172.21.15.16:0/3538272013 shutdown_connections 2024-04-17T14:40:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- 172.21.15.16:0/3538272013 wait complete. 2024-04-17T14:40:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 Processor -- start 2024-04-17T14:40:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.387+0000 7febe0800640 1 -- start start 2024-04-17T14:40:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd80c9120 0x7febd81f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7febd815af50 con 0x7febd8070400 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febd815b860 con 0x7febd80c9120 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febe0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7febd815bd80 con 0x7febd80c9e60 2024-04-17T14:40:02.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febdde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febde800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febdde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47842/0 (socket says 172.21.15.16:47842) 2024-04-17T14:40:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febdde00640 1 -- 172.21.15.16:0/230417575 learned_addr learned my addr 172.21.15.16:0/230417575 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.391+0000 7febdd400640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd80c9120 0x7febd81f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 -- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 msgr2=0x7febd80b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 -- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd80c9120 msgr2=0x7febd81f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd80c9120 0x7febd81f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 -- 172.21.15.16:0/230417575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd80cd630 con 0x7febd8070400 2024-04-17T14:40:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.395+0000 7febdde00640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7febcc00d800 tx=0x7febcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:02.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc00b660 con 0x7febd8070400 2024-04-17T14:40:02.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd80cd8d0 con 0x7febd8070400 2024-04-17T14:40:02.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd80cde50 con 0x7febd8070400 2024-04-17T14:40:02.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febcc019070 con 0x7febd8070400 2024-04-17T14:40:02.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc00ba00 con 0x7febd8070400 2024-04-17T14:40:02.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.399+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb40052a0 con 0x7febd8070400 2024-04-17T14:40:02.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.423+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febcc00bba0 con 0x7febd8070400 2024-04-17T14:40:02.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.423+0000 7febd2000640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 0x7febbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:02.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.427+0000 7febdd400640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 0x7febbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:02.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.427+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7febcc0557d0 con 0x7febd8070400 2024-04-17T14:40:02.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.427+0000 7febdd400640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 0x7febbc06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febc80b2000 tx=0x7febc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.695+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7febcc057730 con 0x7febd8070400 2024-04-17T14:40:02.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:02.899+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7febb4005590 con 0x7febd8070400 2024-04-17T14:40:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febd2000640 1 -- 172.21.15.16:0/230417575 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7febcc05ba30 con 0x7febd8070400 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 msgr2=0x7febbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 0x7febbc06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febc80b2000 tx=0x7febc8009040 comp rx=0 tx=0).stop 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 msgr2=0x7febd80c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7febcc00d800 tx=0x7febcc00dcc0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 shutdown_connections 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7febbc068380 0x7febbc06a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd80c9e60 0x7febd80b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd80c9120 0x7febd81f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 --2- 172.21.15.16:0/230417575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febd8070400 0x7febd80c7c10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 >> 172.21.15.16:0/230417575 conn(0x7febd806dc40 msgr2=0x7febd80c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 shutdown_connections 2024-04-17T14:40:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.443+0000 7febe0800640 1 -- 172.21.15.16:0/230417575 wait complete. 2024-04-17T14:40:03.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-17T14:40:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 Processor -- start 2024-04-17T14:40:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 -- start start 2024-04-17T14:40:03.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d80c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f13d815be40 0x7f13d8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d8158610 con 0x7f13d8158110 2024-04-17T14:40:03.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f13d80c8be0 con 0x7f13d815be40 2024-04-17T14:40:03.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.607+0000 7f13e0400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f13d8071b30 con 0x7f13d8151db0 2024-04-17T14:40:03.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f13d815be40 0x7f13d8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f13d815be40 0x7f13d8157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47856/0 (socket says 172.21.15.16:47856) 2024-04-17T14:40:03.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 -- 172.21.15.16:0/1075535317 learned_addr learned my addr 172.21.15.16:0/1075535317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:03.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dda00640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d80c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 -- 172.21.15.16:0/1075535317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 msgr2=0x7f13d80c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:03.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d80c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.611+0000 7f13dd000640 1 -- 172.21.15.16:0/1075535317 >> v1:172.21.15.16:6789/0 conn(0x7f13d8158110 legacy=0x7f13d80c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.615+0000 7f13dd000640 1 -- 172.21.15.16:0/1075535317 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d81588f0 con 0x7f13d815be40 2024-04-17T14:40:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.619+0000 7f13dd000640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f13c40098a0 tx=0x7f13c401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400208d78b1e1d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:03.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13d7e00640 1 -- 172.21.15.16:0/1075535317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40b5070 con 0x7f13d815be40 2024-04-17T14:40:03.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13d7e00640 1 -- 172.21.15.16:0/1075535317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c40a8a30 con 0x7f13d815be40 2024-04-17T14:40:03.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13d7e00640 1 -- 172.21.15.16:0/1075535317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40a8e00 con 0x7f13d815be40 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- 172.21.15.16:0/1075535317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 msgr2=0x7f13d8157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f13c40098a0 tx=0x7f13c401ed30 comp rx=0 tx=0).stop 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- 172.21.15.16:0/1075535317 shutdown_connections 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 --2- 172.21.15.16:0/1075535317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d80c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- 172.21.15.16:0/1075535317 >> 172.21.15.16:0/1075535317 conn(0x7f13d806ba30 msgr2=0x7f13d806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- 172.21.15.16:0/1075535317 shutdown_connections 2024-04-17T14:40:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- 172.21.15.16:0/1075535317 wait complete. 2024-04-17T14:40:03.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 Processor -- start 2024-04-17T14:40:03.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.623+0000 7f13e0400640 1 -- start start 2024-04-17T14:40:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d8149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13d8158110 0x7f13d8149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13d815b920 con 0x7f13d815be40 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f13d815b640 con 0x7f13d8158110 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13e0400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f13d80c4080 con 0x7f13d8151db0 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13de400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13de400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47868/0 (socket says 172.21.15.16:47868) 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13de400640 1 -- 172.21.15.16:0/381970723 learned_addr learned my addr 172.21.15.16:0/381970723 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:03.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13dda00640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d8149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.627+0000 7f13dd000640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13d8158110 0x7f13d8149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 -- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 msgr2=0x7f13d8149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d8149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 -- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13d8158110 msgr2=0x7f13d8149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13d8158110 0x7f13d8149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 -- 172.21.15.16:0/381970723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d814b920 con 0x7f13d815be40 2024-04-17T14:40:03.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.631+0000 7f13de400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c7a0 tx=0x7f13d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.635+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0003b80 con 0x7f13d815be40 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.635+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0003d20 con 0x7f13d815be40 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.635+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d000aa30 con 0x7f13d815be40 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.635+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d81eb030 con 0x7f13d815be40 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.635+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d8165200 con 0x7f13d815be40 2024-04-17T14:40:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.639+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d81eae50 con 0x7f13d815be40 2024-04-17T14:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.903+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13d000abd0 con 0x7f13d815be40 2024-04-17T14:40:03.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.907+0000 7f13d5600640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 0x7f13b806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:03.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.907+0000 7f13dda00640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 0x7f13b806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:03.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.907+0000 7f13dda00640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 0x7f13b806a890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009b60 tx=0x7f13cc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.919+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f13d0055260 con 0x7f13d815be40 2024-04-17T14:40:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:03.919+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f13d81eae50 con 0x7f13d815be40 2024-04-17T14:40:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.127+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f13d8076280 con 0x7f13d815be40 2024-04-17T14:40:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.595+0000 7f13d5600640 1 -- 172.21.15.16:0/381970723 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7f13d00571c0 con 0x7f13d815be40 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 msgr2=0x7f13b806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 0x7f13b806a890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009b60 tx=0x7f13cc009190 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 msgr2=0x7f13d8157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c7a0 tx=0x7f13d000cc60 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 shutdown_connections 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f13b80683d0 0x7f13b806a890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d815be40 0x7f13d8157340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13d8158110 0x7f13d8149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 --2- 172.21.15.16:0/381970723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13d8151db0 0x7f13d8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 >> 172.21.15.16:0/381970723 conn(0x7f13d806ba30 msgr2=0x7f13d80c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 shutdown_connections 2024-04-17T14:40:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.599+0000 7f13e0400640 1 -- 172.21.15.16:0/381970723 wait complete. 2024-04-17T14:40:04.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T14:40:04.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:40:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 Processor -- start 2024-04-17T14:40:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 -- start start 2024-04-17T14:40:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 0x7feb880c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8815af60 con 0x7feb880c92b0 2024-04-17T14:40:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8815b240 con 0x7feb88154c70 2024-04-17T14:40:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7feb8815bb70 con 0x7feb88155050 2024-04-17T14:40:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8da00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feb880c92b0 0x7feb8815e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35646/0 (socket says 172.21.15.16:35646) 2024-04-17T14:40:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.759+0000 7feb8da00640 1 -- 172.21.15.16:0/2829577436 learned_addr learned my addr 172.21.15.16:0/2829577436 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.763+0000 7feb7fe00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 0x7feb880c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.763+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482312972 0 0) 0x7feb8815af60 con 0x7feb880c92b0 2024-04-17T14:40:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.763+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb6c003530 con 0x7feb880c92b0 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1809890717 0 0) 0x7feb6c003530 con 0x7feb880c92b0 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 msgr2=0x7feb880c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 0x7feb880c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 >> v1:172.21.15.67:6789/0 conn(0x7feb88154c70 legacy=0x7feb8806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8815b520 con 0x7feb880c92b0 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7feb80001a00 con 0x7feb880c92b0 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 >> v1:172.21.15.16:6789/0 conn(0x7feb880c92b0 legacy=0x7feb8815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 0x7feb6c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6c003fc0 0x7feb6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb8815bb70 con 0x7feb6c004d50 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c00bba0 con 0x7feb6c003fc0 2024-04-17T14:40:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.767+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c00bda0 con 0x7feb88155050 2024-04-17T14:40:04.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 -- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 msgr2=0x7feb6c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb88155050 0x7feb6c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 -- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6c003fc0 msgr2=0x7feb6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb6c003fc0 0x7feb6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.771+0000 7feb8da00640 1 -- 172.21.15.16:0/2829577436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c003530 con 0x7feb6c004d50 2024-04-17T14:40:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.775+0000 7feb8da00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb6c0051d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb8000a770 tx=0x7feb8001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f03e581b593a81c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8000a390 con 0x7feb6c004d50 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb800ad650 con 0x7feb6c004d50 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb87e00640 1 -- 172.21.15.16:0/2829577436 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800ada80 con 0x7feb6c004d50 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 -- 172.21.15.16:0/2829577436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 msgr2=0x7feb6c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 --2- 172.21.15.16:0/2829577436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb6c0051d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb8000a770 tx=0x7feb8001d2a0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8da00640 1 -- 172.21.15.16:0/2829577436 reap_dead start 2024-04-17T14:40:04.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 -- 172.21.15.16:0/2829577436 shutdown_connections 2024-04-17T14:40:04.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 -- 172.21.15.16:0/2829577436 >> 172.21.15.16:0/2829577436 conn(0x7feb880cd310 msgr2=0x7feb880cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:04.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 -- 172.21.15.16:0/2829577436 shutdown_connections 2024-04-17T14:40:04.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.779+0000 7feb8fa00640 1 -- 172.21.15.16:0/2829577436 wait complete. 2024-04-17T14:40:04.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 Processor -- start 2024-04-17T14:40:04.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 -- start start 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb8815dd10 0x7feb88149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb880cb110 0x7feb880cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb8815ecf0 con 0x7feb6c004d50 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feb8815eb70 con 0x7feb880cb110 2024-04-17T14:40:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7feb880cc2b0 con 0x7feb8815dd10 2024-04-17T14:40:04.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47888/0 (socket says 172.21.15.16:47888) 2024-04-17T14:40:04.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8d000640 1 -- 172.21.15.16:0/3636474440 learned_addr learned my addr 172.21.15.16:0/3636474440 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:04.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb8da00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb880cb110 0x7feb880cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.783+0000 7feb7fe00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb8815dd10 0x7feb88149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.787+0000 7feb8d000640 1 -- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb8815dd10 msgr2=0x7feb88149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.787+0000 7feb8d000640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb8815dd10 0x7feb88149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.787+0000 7feb8d000640 1 -- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb880cb110 msgr2=0x7feb880cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.787+0000 7feb8d000640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb880cb110 0x7feb880cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.787+0000 7feb8d000640 1 -- 172.21.15.16:0/3636474440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8814aac0 con 0x7feb6c004d50 2024-04-17T14:40:04.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.791+0000 7feb8d000640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c500 tx=0x7feb7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78017070 con 0x7feb6c004d50 2024-04-17T14:40:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb780052d0 con 0x7feb6c004d50 2024-04-17T14:40:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78003840 con 0x7feb6c004d50 2024-04-17T14:40:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb881f1450 con 0x7feb6c004d50 2024-04-17T14:40:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8815c060 con 0x7feb6c004d50 2024-04-17T14:40:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.795+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb88076280 con 0x7feb6c004d50 2024-04-17T14:40:04.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.815+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb7801a070 con 0x7feb6c004d50 2024-04-17T14:40:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.815+0000 7feb85600640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 0x7feb6406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.815+0000 7feb7fe00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 0x7feb6406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.815+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb78054240 con 0x7feb6c004d50 2024-04-17T14:40:04.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:04.815+0000 7feb7fe00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 0x7feb6406a8c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb880cde20 tx=0x7feb70009320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:05.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.075+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7feb78021020 con 0x7feb6c004d50 2024-04-17T14:40:05.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.279+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb8806c980 con 0x7feb6c004d50 2024-04-17T14:40:05.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.303+0000 7feb85600640 1 -- 172.21.15.16:0/3636474440 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7feb78005480 con 0x7feb6c004d50 2024-04-17T14:40:05.302 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:05.302 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T14:40:05.302 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T14:40:05.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 msgr2=0x7feb6406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 0x7feb6406a8c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb880cde20 tx=0x7feb70009320 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 msgr2=0x7feb880ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c500 tx=0x7feb7800c9c0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 shutdown_connections 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7feb64068400 0x7feb6406a8c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb880cb110 0x7feb880cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feb8815dd10 0x7feb88149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 --2- 172.21.15.16:0/3636474440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb6c004d50 0x7feb880ccac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 >> 172.21.15.16:0/3636474440 conn(0x7feb880cd310 msgr2=0x7feb880735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 shutdown_connections 2024-04-17T14:40:05.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.307+0000 7feb8fa00640 1 -- 172.21.15.16:0/3636474440 wait complete. 2024-04-17T14:40:05.324 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:05.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.463+0000 7fa00c600640 1 Processor -- start 2024-04-17T14:40:05.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.463+0000 7fa00c600640 1 -- start start 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004155080 0x7fa00415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa00415ec50 0x7fa0040ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa00415f070 0x7fa0040c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040c8d40 con 0x7fa00415ec50 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa00415b400 con 0x7fa00415f070 2024-04-17T14:40:05.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa00415b6e0 con 0x7fa004155080 2024-04-17T14:40:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa009200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa00415ec50 0x7fa0040ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa009200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa00415ec50 0x7fa0040ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47894/0 (socket says 172.21.15.16:47894) 2024-04-17T14:40:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa009200640 1 -- 172.21.15.16:0/1770396702 learned_addr learned my addr 172.21.15.16:0/1770396702 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa00a600640 1 --2- 172.21.15.16:0/1770396702 >> v2:172.21.15.67:3300/0 conn(0x7fa00415f070 0x7fa0040c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.467+0000 7fa009c00640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004155080 0x7fa00415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.471+0000 7fa009200640 1 -- 172.21.15.16:0/1770396702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004155080 msgr2=0x7fa00415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:05.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.471+0000 7fa009200640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004155080 0x7fa00415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.471+0000 7fa009200640 1 -- 172.21.15.16:0/1770396702 >> v2:172.21.15.67:3300/0 conn(0x7fa00415f070 msgr2=0x7fa0040c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:05.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.471+0000 7fa009200640 1 --2- 172.21.15.16:0/1770396702 >> v2:172.21.15.67:3300/0 conn(0x7fa00415f070 0x7fa0040c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.471+0000 7fa009200640 1 -- 172.21.15.16:0/1770396702 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00415b9c0 con 0x7fa00415ec50 2024-04-17T14:40:05.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.475+0000 7fa009200640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415ec50 0x7fa0040ca9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa00406f450 tx=0x7f9ff001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af2034281a252ca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:05.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa003e00640 1 -- 172.21.15.16:0/1770396702 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00b5070 con 0x7fa00415ec50 2024-04-17T14:40:05.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa003e00640 1 -- 172.21.15.16:0/1770396702 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff00a89d0 con 0x7fa00415ec50 2024-04-17T14:40:05.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa003e00640 1 -- 172.21.15.16:0/1770396702 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00a8da0 con 0x7fa00415ec50 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- 172.21.15.16:0/1770396702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415ec50 msgr2=0x7fa0040ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415ec50 0x7fa0040ca9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa00406f450 tx=0x7f9ff001ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- 172.21.15.16:0/1770396702 shutdown_connections 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- 172.21.15.16:0/1770396702 >> v2:172.21.15.67:3300/0 conn(0x7fa00415f070 0x7fa0040c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415ec50 0x7fa0040ca9f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- 172.21.15.16:0/1770396702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa004155080 0x7fa00415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- 172.21.15.16:0/1770396702 >> 172.21.15.16:0/1770396702 conn(0x7fa00406fd20 msgr2=0x7fa004070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:05.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- 172.21.15.16:0/1770396702 shutdown_connections 2024-04-17T14:40:05.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- 172.21.15.16:0/1770396702 wait complete. 2024-04-17T14:40:05.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 Processor -- start 2024-04-17T14:40:05.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- start start 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa004155080 0x7fa0041f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa00415ec50 0x7fa0040c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa004155460 con 0x7fa00415f070 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa00415e730 con 0x7fa004155080 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.479+0000 7fa00c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040cb7e0 con 0x7fa00415ec50 2024-04-17T14:40:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.483+0000 7fa00a600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.483+0000 7fa00a600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47900/0 (socket says 172.21.15.16:47900) 2024-04-17T14:40:05.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.483+0000 7fa00a600640 1 -- 172.21.15.16:0/4115703066 learned_addr learned my addr 172.21.15.16:0/4115703066 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:05.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.483+0000 7fa009c00640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa004155080 0x7fa0041f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.483+0000 7fa009200640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa00415ec50 0x7fa0040c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 -- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa00415ec50 msgr2=0x7fa0040c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa00415ec50 0x7fa0040c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 -- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa004155080 msgr2=0x7fa0041f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa004155080 0x7fa0041f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 -- 172.21.15.16:0/4115703066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040cbcb0 con 0x7fa00415f070 2024-04-17T14:40:05.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.487+0000 7fa00a600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc007e90 tx=0x7f9ffc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc014420 con 0x7fa00415f070 2024-04-17T14:40:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc019070 con 0x7fa00415f070 2024-04-17T14:40:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc014800 con 0x7fa00415f070 2024-04-17T14:40:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0040cbf90 con 0x7fa00415f070 2024-04-17T14:40:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0040cc550 con 0x7fa00415f070 2024-04-17T14:40:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.491+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa004076280 con 0x7fa00415f070 2024-04-17T14:40:05.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.763+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ffc0149a0 con 0x7fa00415f070 2024-04-17T14:40:05.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.763+0000 7fa001600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 0x7f9fe406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:05.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.763+0000 7fa009c00640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 0x7f9fe406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:05.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.763+0000 7fa009c00640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 0x7f9fe406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80045f0 tx=0x7f9ff8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.775+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc055f30 con 0x7fa00415f070 2024-04-17T14:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.775+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9ffc057e90 con 0x7fa00415f070 2024-04-17T14:40:05.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.947+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0040ca4a0 con 0x7fa00415f070 2024-04-17T14:40:05.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa001600640 1 -- 172.21.15.16:0/4115703066 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16561 (secure 0 0 0) 0x7f9ffc05c190 con 0x7fa00415f070 2024-04-17T14:40:05.989 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:05.989 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:02.011377+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 msgr2=0x7f9fe406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 0x7f9fe406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80045f0 tx=0x7f9ff8008040 comp rx=0 tx=0).stop 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 msgr2=0x7fa0040ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc007e90 tx=0x7f9ffc00e4b0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 shutdown_connections 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9fe4068400 0x7f9fe406a8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00415f070 0x7fa0040ccc40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa00415ec50 0x7fa0040c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 --2- 172.21.15.16:0/4115703066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa004155080 0x7fa0041f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:05.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 >> 172.21.15.16:0/4115703066 conn(0x7fa00406fd20 msgr2=0x7fa0040c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:05.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 shutdown_connections 2024-04-17T14:40:05.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:05.991+0000 7fa00c600640 1 -- 172.21.15.16:0/4115703066 wait complete. 2024-04-17T14:40:06.013 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T14:40:06.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T14:40:06.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.155+0000 7fc1abc00640 1 Processor -- start 2024-04-17T14:40:06.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.155+0000 7fc1abc00640 1 -- start start 2024-04-17T14:40:06.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1abc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc1a40c5a20 0x7fc1a40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1abc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a4158610 con 0x7fc1a4151db0 2024-04-17T14:40:06.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1abc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a41588f0 con 0x7fc1a415be40 2024-04-17T14:40:06.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1abc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a40c8be0 con 0x7fc1a40c5a20 2024-04-17T14:40:06.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1a9200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc1a4151db0 0x7fc1a4157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35648/0 (socket says 172.21.15.16:35648) 2024-04-17T14:40:06.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1a9200640 1 -- 172.21.15.16:0/356696872 learned_addr learned my addr 172.21.15.16:0/356696872 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:06.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.159+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/356696872 >> v2:172.21.15.67:3300/0 conn(0x7fc1a40c5a20 0x7fc1a40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.163+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223166966 0 0) 0x7fc1a4158610 con 0x7fc1a4151db0 2024-04-17T14:40:06.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.163+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc188003530 con 0x7fc1a4151db0 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 147536024 0 0) 0x7fc188003530 con 0x7fc1a4151db0 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 >> v2:172.21.15.67:3300/0 conn(0x7fc1a40c5a20 msgr2=0x7fc1a40c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 --2- 172.21.15.16:0/356696872 >> v2:172.21.15.67:3300/0 conn(0x7fc1a40c5a20 0x7fc1a40c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 >> v1:172.21.15.67:6789/0 conn(0x7fc1a415be40 legacy=0x7fc1a40c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a415b360 con 0x7fc1a4151db0 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fc194001680 con 0x7fc1a4151db0 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 >> v1:172.21.15.16:6789/0 conn(0x7fc1a4151db0 legacy=0x7fc1a4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc188003a10 0x7fc188003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc188004810 0x7fc188004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 0x7fc18800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc18800c050 con 0x7fc1880051d0 2024-04-17T14:40:06.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc18800c200 con 0x7fc188003a10 2024-04-17T14:40:06.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fc18800c400 con 0x7fc188004810 2024-04-17T14:40:06.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc19be00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc188004810 0x7fc188004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.167+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 0x7fc18800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.171+0000 7fc1a9c00640 1 -- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc188004810 msgr2=0x7fc188004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.171+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc188004810 0x7fc188004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.171+0000 7fc1a9c00640 1 -- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc188003a10 msgr2=0x7fc188003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.171+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc188003a10 0x7fc188003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.171+0000 7fc1a9c00640 1 -- 172.21.15.16:0/356696872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc188003530 con 0x7fc1880051d0 2024-04-17T14:40:06.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.175+0000 7fc1a9c00640 1 -- 172.21.15.16:0/356696872 reap_dead start 2024-04-17T14:40:06.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.175+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 0x7fc18800b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009fc0 tx=0x7fc19c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f0247db8177211 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c009c10 con 0x7fc1880051d0 2024-04-17T14:40:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c0a5d10 con 0x7fc1880051d0 2024-04-17T14:40:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1a3e00640 1 -- 172.21.15.16:0/356696872 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c003be0 con 0x7fc1880051d0 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 -- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 msgr2=0x7fc18800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 0x7fc18800b9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009fc0 tx=0x7fc19c01ccc0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 -- 172.21.15.16:0/356696872 shutdown_connections 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 --2- 172.21.15.16:0/356696872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1880051d0 0x7fc18800b9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 -- 172.21.15.16:0/356696872 >> 172.21.15.16:0/356696872 conn(0x7fc1a406ba30 msgr2=0x7fc1a406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 -- 172.21.15.16:0/356696872 shutdown_connections 2024-04-17T14:40:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.179+0000 7fc1abc00640 1 -- 172.21.15.16:0/356696872 wait complete. 2024-04-17T14:40:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 Processor -- start 2024-04-17T14:40:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 -- start start 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1880051d0 0x7fc1a4159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a4155100 0x7fc1a4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a415b920 con 0x7fc1a41585f0 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4071b30 con 0x7fc1880051d0 2024-04-17T14:40:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.183+0000 7fc1abc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a4152190 con 0x7fc1a4155100 2024-04-17T14:40:06.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.187+0000 7fc1a9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1880051d0 0x7fc1a4159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.187+0000 7fc19be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.187+0000 7fc19be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47906/0 (socket says 172.21.15.16:47906) 2024-04-17T14:40:06.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.187+0000 7fc19be00640 1 -- 172.21.15.16:0/2968487873 learned_addr learned my addr 172.21.15.16:0/2968487873 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:06.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.187+0000 7fc1a9c00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a4155100 0x7fc1a4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.191+0000 7fc19be00640 1 -- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a4155100 msgr2=0x7fc1a4152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.191+0000 7fc19be00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a4155100 0x7fc1a4152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.191+0000 7fc19be00640 1 -- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1880051d0 msgr2=0x7fc1a4159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.191+0000 7fc19be00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1880051d0 0x7fc1a4159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.191+0000 7fc19be00640 1 -- 172.21.15.16:0/2968487873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a415ad80 con 0x7fc1a41585f0 2024-04-17T14:40:06.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.195+0000 7fc19be00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00f670 tx=0x7fc18c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0050d0 con 0x7fc1a41585f0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c018070 con 0x7fc1a41585f0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c00d730 con 0x7fc1a41585f0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a41f11c0 con 0x7fc1a41585f0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a41f1460 con 0x7fc1a41585f0 2024-04-17T14:40:06.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.199+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a4076280 con 0x7fc1a41585f0 2024-04-17T14:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.467+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc18c00d8d0 con 0x7fc1a41585f0 2024-04-17T14:40:06.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.467+0000 7fc1a1600640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 0x7fc18006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.467+0000 7fc1a9200640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 0x7fc18006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.471+0000 7fc1a9200640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 0x7fc18006a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc194001ec0 tx=0x7fc194001740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:06.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.479+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc18c0551b0 con 0x7fc1a41585f0 2024-04-17T14:40:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.479+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc18c057810 con 0x7fc1a41585f0 2024-04-17T14:40:06.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.643+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1a40c4400 con 0x7fc180068400 2024-04-17T14:40:06.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.663+0000 7fc1a1600640 1 -- 172.21.15.16:0/2968487873 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fc1a40c4400 con 0x7fc180068400 2024-04-17T14:40:06.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:06.666 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T14:40:06.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 msgr2=0x7fc18006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 0x7fc18006a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc194001ec0 tx=0x7fc194001740 comp rx=0 tx=0).stop 2024-04-17T14:40:06.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 msgr2=0x7fc1a4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00f670 tx=0x7fc18c00fb30 comp rx=0 tx=0).stop 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 shutdown_connections 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fc180068400 0x7fc18006a8c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a4155100 0x7fc1a4152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a41585f0 0x7fc1a4152640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 --2- 172.21.15.16:0/2968487873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1880051d0 0x7fc1a4159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 >> 172.21.15.16:0/2968487873 conn(0x7fc1a406ba30 msgr2=0x7fc1a4072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 shutdown_connections 2024-04-17T14:40:06.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.667+0000 7fc1abc00640 1 -- 172.21.15.16:0/2968487873 wait complete. 2024-04-17T14:40:06.686 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-17T14:40:05.001226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235848,"kb_used_data":3024,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738872,"statfs":{"total":773094113280,"available":772852604928,"internally_reserved":0,"allocated":3096576,"data_stored":1834114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002511"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411018+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T14:40:02.411018+0000","last_peered":"2024-04-17T14:40:02.411018+0000","last_clean":"2024-04-17T14:40:02.411018+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T14:40:02.411018+0000","last_undegraded":"2024-04-17T14:40:02.411018+0000","last_fullsized":"2024-04-17T14:40:02.411018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023673+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T14:40:01.023673+0000","last_peered":"2024-04-17T14:40:01.023673+0000","last_clean":"2024-04-17T14:40:01.023673+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T14:40:01.023673+0000","last_undegraded":"2024-04-17T14:40:01.023673+0000","last_fullsized":"2024-04-17T14:40:01.023673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023406+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T14:40:01.023406+0000","last_peered":"2024-04-17T14:40:01.023406+0000","last_clean":"2024-04-17T14:40:01.023406+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T14:40:01.023406+0000","last_undegraded":"2024-04-17T14:40:01.023406+0000","last_fullsized":"2024-04-17T14:40:01.023406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410013+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T14:40:02.410013+0000","last_peered":"2024-04-17T14:40:02.410013+0000","last_clean":"2024-04-17T14:40:02.410013+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T14:40:02.410013+0000","last_undegraded":"2024-04-17T14:40:02.410013+0000","last_fullsized":"2024-04-17T14:40:02.410013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410005+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T14:40:02.410005+0000","last_peered":"2024-04-17T14:40:02.410005+0000","last_clean":"2024-04-17T14:40:02.410005+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T14:40:02.410005+0000","last_undegraded":"2024-04-17T14:40:02.410005+0000","last_fullsized":"2024-04-17T14:40:02.410005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409846+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T14:40:02.409846+0000","last_peered":"2024-04-17T14:40:02.409846+0000","last_clean":"2024-04-17T14:40:02.409846+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T14:40:02.409846+0000","last_undegraded":"2024-04-17T14:40:02.409846+0000","last_fullsized":"2024-04-17T14:40:02.409846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409642+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T14:40:02.409642+0000","last_peered":"2024-04-17T14:40:02.409642+0000","last_clean":"2024-04-17T14:40:02.409642+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T14:40:02.409642+0000","last_undegraded":"2024-04-17T14:40:02.409642+0000","last_fullsized":"2024-04-17T14:40:02.409642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022223+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T14:40:01.022223+0000","last_peered":"2024-04-17T14:40:01.022223+0000","last_clean":"2024-04-17T14:40:01.022223+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T14:40:01.022223+0000","last_undegraded":"2024-04-17T14:40:01.022223+0000","last_fullsized":"2024-04-17T14:40:01.022223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411264+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T14:40:02.411264+0000","last_peered":"2024-04-17T14:40:02.411264+0000","last_clean":"2024-04-17T14:40:02.411264+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T14:40:02.411264+0000","last_undegraded":"2024-04-17T14:40:02.411264+0000","last_fullsized":"2024-04-17T14:40:02.411264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409793+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T14:40:02.409793+0000","last_peered":"2024-04-17T14:40:02.409793+0000","last_clean":"2024-04-17T14:40:02.409793+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T14:40:02.409793+0000","last_undegraded":"2024-04-17T14:40:02.409793+0000","last_fullsized":"2024-04-17T14:40:02.409793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410244+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T14:40:02.410244+0000","last_peered":"2024-04-17T14:40:02.410244+0000","last_clean":"2024-04-17T14:40:02.410244+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T14:40:02.410244+0000","last_undegraded":"2024-04-17T14:40:02.410244+0000","last_fullsized":"2024-04-17T14:40:02.410244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409932+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T14:40:02.409932+0000","last_peered":"2024-04-17T14:40:02.409932+0000","last_clean":"2024-04-17T14:40:02.409932+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T14:40:02.409932+0000","last_undegraded":"2024-04-17T14:40:02.409932+0000","last_fullsized":"2024-04-17T14:40:02.409932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262572+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T14:40:02.262572+0000","last_peered":"2024-04-17T14:40:02.262572+0000","last_clean":"2024-04-17T14:40:02.262572+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T14:40:02.262572+0000","last_undegraded":"2024-04-17T14:40:02.262572+0000","last_fullsized":"2024-04-17T14:40:02.262572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262633+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T14:40:02.262633+0000","last_peered":"2024-04-17T14:40:02.262633+0000","last_clean":"2024-04-17T14:40:02.262633+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T14:40:02.262633+0000","last_undegraded":"2024-04-17T14:40:02.262633+0000","last_fullsized":"2024-04-17T14:40:02.262633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022328+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T14:40:01.022328+0000","last_peered":"2024-04-17T14:40:01.022328+0000","last_clean":"2024-04-17T14:40:01.022328+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T14:40:01.022328+0000","last_undegraded":"2024-04-17T14:40:01.022328+0000","last_fullsized":"2024-04-17T14:40:01.022328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410485+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T14:40:02.410485+0000","last_peered":"2024-04-17T14:40:02.410485+0000","last_clean":"2024-04-17T14:40:02.410485+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T14:40:02.410485+0000","last_undegraded":"2024-04-17T14:40:02.410485+0000","last_fullsized":"2024-04-17T14:40:02.410485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411629+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T14:40:02.411629+0000","last_peered":"2024-04-17T14:40:02.411629+0000","last_clean":"2024-04-17T14:40:02.411629+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T14:40:02.411629+0000","last_undegraded":"2024-04-17T14:40:02.411629+0000","last_fullsized":"2024-04-17T14:40:02.411629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.075884+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T14:40:01.075884+0000","last_peered":"2024-04-17T14:40:01.075884+0000","last_clean":"2024-04-17T14:40:01.075884+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T14:40:01.075884+0000","last_undegraded":"2024-04-17T14:40:01.075884+0000","last_fullsized":"2024-04-17T14:40:01.075884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411948+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T14:40:02.411948+0000","last_peered":"2024-04-17T14:40:02.411948+0000","last_clean":"2024-04-17T14:40:02.411948+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T14:40:02.411948+0000","last_undegraded":"2024-04-17T14:40:02.411948+0000","last_fullsized":"2024-04-17T14:40:02.411948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410015+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T14:40:02.410015+0000","last_peered":"2024-04-17T14:40:02.410015+0000","last_clean":"2024-04-17T14:40:02.410015+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T14:40:02.410015+0000","last_undegraded":"2024-04-17T14:40:02.410015+0000","last_fullsized":"2024-04-17T14:40:02.410015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268563+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T14:40:02.268563+0000","last_peered":"2024-04-17T14:40:02.268563+0000","last_clean":"2024-04-17T14:40:02.268563+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T14:40:02.268563+0000","last_undegraded":"2024-04-17T14:40:02.268563+0000","last_fullsized":"2024-04-17T14:40:02.268563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410840+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T14:40:02.410840+0000","last_peered":"2024-04-17T14:40:02.410840+0000","last_clean":"2024-04-17T14:40:02.410840+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T14:40:02.410840+0000","last_undegraded":"2024-04-17T14:40:02.410840+0000","last_fullsized":"2024-04-17T14:40:02.410840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022421+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T14:40:01.022421+0000","last_peered":"2024-04-17T14:40:01.022421+0000","last_clean":"2024-04-17T14:40:01.022421+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T14:40:01.022421+0000","last_undegraded":"2024-04-17T14:40:01.022421+0000","last_fullsized":"2024-04-17T14:40:01.022421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410554+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T14:40:02.410554+0000","last_peered":"2024-04-17T14:40:02.410554+0000","last_clean":"2024-04-17T14:40:02.410554+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T14:40:02.410554+0000","last_undegraded":"2024-04-17T14:40:02.410554+0000","last_fullsized":"2024-04-17T14:40:02.410554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023814+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T14:40:01.023814+0000","last_peered":"2024-04-17T14:40:01.023814+0000","last_clean":"2024-04-17T14:40:01.023814+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T14:40:01.023814+0000","last_undegraded":"2024-04-17T14:40:01.023814+0000","last_fullsized":"2024-04-17T14:40:01.023814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410050+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T14:40:02.410050+0000","last_peered":"2024-04-17T14:40:02.410050+0000","last_clean":"2024-04-17T14:40:02.410050+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T14:40:02.410050+0000","last_undegraded":"2024-04-17T14:40:02.410050+0000","last_fullsized":"2024-04-17T14:40:02.410050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263613+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T14:40:02.263613+0000","last_peered":"2024-04-17T14:40:02.263613+0000","last_clean":"2024-04-17T14:40:02.263613+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T14:40:02.263613+0000","last_undegraded":"2024-04-17T14:40:02.263613+0000","last_fullsized":"2024-04-17T14:40:02.263613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262588+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T14:40:02.262588+0000","last_peered":"2024-04-17T14:40:02.262588+0000","last_clean":"2024-04-17T14:40:02.262588+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T14:40:02.262588+0000","last_undegraded":"2024-04-17T14:40:02.262588+0000","last_fullsized":"2024-04-17T14:40:02.262588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022909+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T14:40:01.022909+0000","last_peered":"2024-04-17T14:40:01.022909+0000","last_clean":"2024-04-17T14:40:01.022909+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T14:40:01.022909+0000","last_undegraded":"2024-04-17T14:40:01.022909+0000","last_fullsized":"2024-04-17T14:40:01.022909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411149+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T14:40:02.411149+0000","last_peered":"2024-04-17T14:40:02.411149+0000","last_clean":"2024-04-17T14:40:02.411149+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T14:40:02.411149+0000","last_undegraded":"2024-04-17T14:40:02.411149+0000","last_fullsized":"2024-04-17T14:40:02.411149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.075068+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T14:40:01.075068+0000","last_peered":"2024-04-17T14:40:01.075068+0000","last_clean":"2024-04-17T14:40:01.075068+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T14:40:01.075068+0000","last_undegraded":"2024-04-17T14:40:01.075068+0000","last_fullsized":"2024-04-17T14:40:01.075068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409384+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T14:40:02.409384+0000","last_peered":"2024-04-17T14:40:02.409384+0000","last_clean":"2024-04-17T14:40:02.409384+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T14:40:02.409384+0000","last_undegraded":"2024-04-17T14:40:02.409384+0000","last_fullsized":"2024-04-17T14:40:02.409384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410914+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T14:40:02.410914+0000","last_peered":"2024-04-17T14:40:02.410914+0000","last_clean":"2024-04-17T14:40:02.410914+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T14:40:02.410914+0000","last_undegraded":"2024-04-17T14:40:02.410914+0000","last_fullsized":"2024-04-17T14:40:02.410914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023224+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T14:40:01.023224+0000","last_peered":"2024-04-17T14:40:01.023224+0000","last_clean":"2024-04-17T14:40:01.023224+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T14:40:01.023224+0000","last_undegraded":"2024-04-17T14:40:01.023224+0000","last_fullsized":"2024-04-17T14:40:01.023224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268827+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T14:40:02.268827+0000","last_peered":"2024-04-17T14:40:02.268827+0000","last_clean":"2024-04-17T14:40:02.268827+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T14:40:02.268827+0000","last_undegraded":"2024-04-17T14:40:02.268827+0000","last_fullsized":"2024-04-17T14:40:02.268827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411298+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T14:40:02.411298+0000","last_peered":"2024-04-17T14:40:02.411298+0000","last_clean":"2024-04-17T14:40:02.411298+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T14:40:02.411298+0000","last_undegraded":"2024-04-17T14:40:02.411298+0000","last_fullsized":"2024-04-17T14:40:02.411298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262350+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T14:40:02.262350+0000","last_peered":"2024-04-17T14:40:02.262350+0000","last_clean":"2024-04-17T14:40:02.262350+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T14:40:02.262350+0000","last_undegraded":"2024-04-17T14:40:02.262350+0000","last_fullsized":"2024-04-17T14:40:02.262350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022687+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T14:40:01.022687+0000","last_peered":"2024-04-17T14:40:01.022687+0000","last_clean":"2024-04-17T14:40:01.022687+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T14:40:01.022687+0000","last_undegraded":"2024-04-17T14:40:01.022687+0000","last_fullsized":"2024-04-17T14:40:01.022687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411097+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T14:40:02.411097+0000","last_peered":"2024-04-17T14:40:02.411097+0000","last_clean":"2024-04-17T14:40:02.411097+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T14:40:02.411097+0000","last_undegraded":"2024-04-17T14:40:02.411097+0000","last_fullsized":"2024-04-17T14:40:02.411097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268137+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T14:40:02.268137+0000","last_peered":"2024-04-17T14:40:02.268137+0000","last_clean":"2024-04-17T14:40:02.268137+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T14:40:02.268137+0000","last_undegraded":"2024-04-17T14:40:02.268137+0000","last_fullsized":"2024-04-17T14:40:02.268137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411460+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T14:40:02.411460+0000","last_peered":"2024-04-17T14:40:02.411460+0000","last_clean":"2024-04-17T14:40:02.411460+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T14:40:02.411460+0000","last_undegraded":"2024-04-17T14:40:02.411460+0000","last_fullsized":"2024-04-17T14:40:02.411460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410071+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T14:40:02.410071+0000","last_peered":"2024-04-17T14:40:02.410071+0000","last_clean":"2024-04-17T14:40:02.410071+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T14:40:02.410071+0000","last_undegraded":"2024-04-17T14:40:02.410071+0000","last_fullsized":"2024-04-17T14:40:02.410071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409948+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T14:40:02.409948+0000","last_peered":"2024-04-17T14:40:02.409948+0000","last_clean":"2024-04-17T14:40:02.409948+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T14:40:02.409948+0000","last_undegraded":"2024-04-17T14:40:02.409948+0000","last_fullsized":"2024-04-17T14:40:02.409948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.024205+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T14:40:01.024205+0000","last_peered":"2024-04-17T14:40:01.024205+0000","last_clean":"2024-04-17T14:40:01.024205+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T14:40:01.024205+0000","last_undegraded":"2024-04-17T14:40:01.024205+0000","last_fullsized":"2024-04-17T14:40:01.024205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.077918+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T14:40:01.077918+0000","last_peered":"2024-04-17T14:40:01.077918+0000","last_clean":"2024-04-17T14:40:01.077918+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T14:40:01.077918+0000","last_undegraded":"2024-04-17T14:40:01.077918+0000","last_fullsized":"2024-04-17T14:40:01.077918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411563+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T14:40:02.411563+0000","last_peered":"2024-04-17T14:40:02.411563+0000","last_clean":"2024-04-17T14:40:02.411563+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T14:40:02.411563+0000","last_undegraded":"2024-04-17T14:40:02.411563+0000","last_fullsized":"2024-04-17T14:40:02.411563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410106+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T14:40:02.410106+0000","last_peered":"2024-04-17T14:40:02.410106+0000","last_clean":"2024-04-17T14:40:02.410106+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T14:40:02.410106+0000","last_undegraded":"2024-04-17T14:40:02.410106+0000","last_fullsized":"2024-04-17T14:40:02.410106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410341+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T14:40:02.410341+0000","last_peered":"2024-04-17T14:40:02.410341+0000","last_clean":"2024-04-17T14:40:02.410341+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T14:40:02.410341+0000","last_undegraded":"2024-04-17T14:40:02.410341+0000","last_fullsized":"2024-04-17T14:40:02.410341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.075770+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T14:40:01.075770+0000","last_peered":"2024-04-17T14:40:01.075770+0000","last_clean":"2024-04-17T14:40:01.075770+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T14:40:01.075770+0000","last_undegraded":"2024-04-17T14:40:01.075770+0000","last_fullsized":"2024-04-17T14:40:01.075770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262885+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T14:40:02.262885+0000","last_peered":"2024-04-17T14:40:02.262885+0000","last_clean":"2024-04-17T14:40:02.262885+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T14:40:02.262885+0000","last_undegraded":"2024-04-17T14:40:02.262885+0000","last_fullsized":"2024-04-17T14:40:02.262885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411399+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T14:40:02.411399+0000","last_peered":"2024-04-17T14:40:02.411399+0000","last_clean":"2024-04-17T14:40:02.411399+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T14:40:02.411399+0000","last_undegraded":"2024-04-17T14:40:02.411399+0000","last_fullsized":"2024-04-17T14:40:02.411399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411503+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T14:40:02.411503+0000","last_peered":"2024-04-17T14:40:02.411503+0000","last_clean":"2024-04-17T14:40:02.411503+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T14:40:02.411503+0000","last_undegraded":"2024-04-17T14:40:02.411503+0000","last_fullsized":"2024-04-17T14:40:02.411503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409638+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T14:40:02.409638+0000","last_peered":"2024-04-17T14:40:02.409638+0000","last_clean":"2024-04-17T14:40:02.409638+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T14:40:02.409638+0000","last_undegraded":"2024-04-17T14:40:02.409638+0000","last_fullsized":"2024-04-17T14:40:02.409638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410778+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T14:40:02.410778+0000","last_peered":"2024-04-17T14:40:02.410778+0000","last_clean":"2024-04-17T14:40:02.410778+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T14:40:02.410778+0000","last_undegraded":"2024-04-17T14:40:02.410778+0000","last_fullsized":"2024-04-17T14:40:02.410778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.267791+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T14:40:02.267791+0000","last_peered":"2024-04-17T14:40:02.267791+0000","last_clean":"2024-04-17T14:40:02.267791+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T14:40:02.267791+0000","last_undegraded":"2024-04-17T14:40:02.267791+0000","last_fullsized":"2024-04-17T14:40:02.267791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411023+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T14:40:02.411023+0000","last_peered":"2024-04-17T14:40:02.411023+0000","last_clean":"2024-04-17T14:40:02.411023+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T14:40:02.411023+0000","last_undegraded":"2024-04-17T14:40:02.411023+0000","last_fullsized":"2024-04-17T14:40:02.411023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411263+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T14:40:02.411263+0000","last_peered":"2024-04-17T14:40:02.411263+0000","last_clean":"2024-04-17T14:40:02.411263+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T14:40:02.411263+0000","last_undegraded":"2024-04-17T14:40:02.411263+0000","last_fullsized":"2024-04-17T14:40:02.411263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410136+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T14:40:02.410136+0000","last_peered":"2024-04-17T14:40:02.410136+0000","last_clean":"2024-04-17T14:40:02.410136+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T14:40:02.410136+0000","last_undegraded":"2024-04-17T14:40:02.410136+0000","last_fullsized":"2024-04-17T14:40:02.410136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268964+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T14:40:02.268964+0000","last_peered":"2024-04-17T14:40:02.268964+0000","last_clean":"2024-04-17T14:40:02.268964+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T14:40:02.268964+0000","last_undegraded":"2024-04-17T14:40:02.268964+0000","last_fullsized":"2024-04-17T14:40:02.268964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411102+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T14:40:02.411102+0000","last_peered":"2024-04-17T14:40:02.411102+0000","last_clean":"2024-04-17T14:40:02.411102+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T14:40:02.411102+0000","last_undegraded":"2024-04-17T14:40:02.411102+0000","last_fullsized":"2024-04-17T14:40:02.411102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023665+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T14:40:01.023665+0000","last_peered":"2024-04-17T14:40:01.023665+0000","last_clean":"2024-04-17T14:40:01.023665+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T14:40:01.023665+0000","last_undegraded":"2024-04-17T14:40:01.023665+0000","last_fullsized":"2024-04-17T14:40:01.023665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410093+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T14:40:02.410093+0000","last_peered":"2024-04-17T14:40:02.410093+0000","last_clean":"2024-04-17T14:40:02.410093+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T14:40:02.410093+0000","last_undegraded":"2024-04-17T14:40:02.410093+0000","last_fullsized":"2024-04-17T14:40:02.410093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263065+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T14:40:02.263065+0000","last_peered":"2024-04-17T14:40:02.263065+0000","last_clean":"2024-04-17T14:40:02.263065+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T14:40:02.263065+0000","last_undegraded":"2024-04-17T14:40:02.263065+0000","last_fullsized":"2024-04-17T14:40:02.263065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411856+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T14:40:02.411856+0000","last_peered":"2024-04-17T14:40:02.411856+0000","last_clean":"2024-04-17T14:40:02.411856+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T14:40:02.411856+0000","last_undegraded":"2024-04-17T14:40:02.411856+0000","last_fullsized":"2024-04-17T14:40:02.411856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410886+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T14:40:02.410886+0000","last_peered":"2024-04-17T14:40:02.410886+0000","last_clean":"2024-04-17T14:40:02.410886+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T14:40:02.410886+0000","last_undegraded":"2024-04-17T14:40:02.410886+0000","last_fullsized":"2024-04-17T14:40:02.410886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411627+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T14:40:02.411627+0000","last_peered":"2024-04-17T14:40:02.411627+0000","last_clean":"2024-04-17T14:40:02.411627+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T14:40:02.411627+0000","last_undegraded":"2024-04-17T14:40:02.411627+0000","last_fullsized":"2024-04-17T14:40:02.411627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268440+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T14:40:02.268440+0000","last_peered":"2024-04-17T14:40:02.268440+0000","last_clean":"2024-04-17T14:40:02.268440+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T14:40:02.268440+0000","last_undegraded":"2024-04-17T14:40:02.268440+0000","last_fullsized":"2024-04-17T14:40:02.268440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411143+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T14:40:02.411143+0000","last_peered":"2024-04-17T14:40:02.411143+0000","last_clean":"2024-04-17T14:40:02.411143+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T14:40:02.411143+0000","last_undegraded":"2024-04-17T14:40:02.411143+0000","last_fullsized":"2024-04-17T14:40:02.411143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262229+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T14:40:02.262229+0000","last_peered":"2024-04-17T14:40:02.262229+0000","last_clean":"2024-04-17T14:40:02.262229+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T14:40:02.262229+0000","last_undegraded":"2024-04-17T14:40:02.262229+0000","last_fullsized":"2024-04-17T14:40:02.262229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.075194+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T14:40:01.075194+0000","last_peered":"2024-04-17T14:40:01.075194+0000","last_clean":"2024-04-17T14:40:01.075194+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T14:40:01.075194+0000","last_undegraded":"2024-04-17T14:40:01.075194+0000","last_fullsized":"2024-04-17T14:40:01.075194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.022421+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T14:40:01.022421+0000","last_peered":"2024-04-17T14:40:01.022421+0000","last_clean":"2024-04-17T14:40:01.022421+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T14:40:01.022421+0000","last_undegraded":"2024-04-17T14:40:01.022421+0000","last_fullsized":"2024-04-17T14:40:01.022421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411479+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T14:40:02.411479+0000","last_peered":"2024-04-17T14:40:02.411479+0000","last_clean":"2024-04-17T14:40:02.411479+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T14:40:02.411479+0000","last_undegraded":"2024-04-17T14:40:02.411479+0000","last_fullsized":"2024-04-17T14:40:02.411479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409655+0000","last_change":"2024-04-17T14:39:59.452343+0000","last_active":"2024-04-17T14:40:02.409655+0000","last_peered":"2024-04-17T14:40:02.409655+0000","last_clean":"2024-04-17T14:40:02.409655+0000","last_became_active":"2024-04-17T14:39:59.449792+0000","last_became_peered":"2024-04-17T14:39:59.449792+0000","last_unstale":"2024-04-17T14:40:02.409655+0000","last_undegraded":"2024-04-17T14:40:02.409655+0000","last_fullsized":"2024-04-17T14:40:02.409655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023481+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T14:40:01.023481+0000","last_peered":"2024-04-17T14:40:01.023481+0000","last_clean":"2024-04-17T14:40:01.023481+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T14:40:01.023481+0000","last_undegraded":"2024-04-17T14:40:01.023481+0000","last_fullsized":"2024-04-17T14:40:01.023481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410680+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T14:40:02.410680+0000","last_peered":"2024-04-17T14:40:02.410680+0000","last_clean":"2024-04-17T14:40:02.410680+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T14:40:02.410680+0000","last_undegraded":"2024-04-17T14:40:02.410680+0000","last_fullsized":"2024-04-17T14:40:02.410680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411997+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T14:40:02.411997+0000","last_peered":"2024-04-17T14:40:02.411997+0000","last_clean":"2024-04-17T14:40:02.411997+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T14:40:02.411997+0000","last_undegraded":"2024-04-17T14:40:02.411997+0000","last_fullsized":"2024-04-17T14:40:02.411997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262815+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T14:40:02.262815+0000","last_peered":"2024-04-17T14:40:02.262815+0000","last_clean":"2024-04-17T14:40:02.262815+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T14:40:02.262815+0000","last_undegraded":"2024-04-17T14:40:02.262815+0000","last_fullsized":"2024-04-17T14:40:02.262815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.269244+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T14:40:02.269244+0000","last_peered":"2024-04-17T14:40:02.269244+0000","last_clean":"2024-04-17T14:40:02.269244+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T14:40:02.269244+0000","last_undegraded":"2024-04-17T14:40:02.269244+0000","last_fullsized":"2024-04-17T14:40:02.269244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268660+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T14:40:02.268660+0000","last_peered":"2024-04-17T14:40:02.268660+0000","last_clean":"2024-04-17T14:40:02.268660+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T14:40:02.268660+0000","last_undegraded":"2024-04-17T14:40:02.268660+0000","last_fullsized":"2024-04-17T14:40:02.268660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411605+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T14:40:02.411605+0000","last_peered":"2024-04-17T14:40:02.411605+0000","last_clean":"2024-04-17T14:40:02.411605+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T14:40:02.411605+0000","last_undegraded":"2024-04-17T14:40:02.411605+0000","last_fullsized":"2024-04-17T14:40:02.411605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268719+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T14:40:02.268719+0000","last_peered":"2024-04-17T14:40:02.268719+0000","last_clean":"2024-04-17T14:40:02.268719+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T14:40:02.268719+0000","last_undegraded":"2024-04-17T14:40:02.268719+0000","last_fullsized":"2024-04-17T14:40:02.268719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409576+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T14:40:02.409576+0000","last_peered":"2024-04-17T14:40:02.409576+0000","last_clean":"2024-04-17T14:40:02.409576+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T14:40:02.409576+0000","last_undegraded":"2024-04-17T14:40:02.409576+0000","last_fullsized":"2024-04-17T14:40:02.409576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411113+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T14:40:02.411113+0000","last_peered":"2024-04-17T14:40:02.411113+0000","last_clean":"2024-04-17T14:40:02.411113+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T14:40:02.411113+0000","last_undegraded":"2024-04-17T14:40:02.411113+0000","last_fullsized":"2024-04-17T14:40:02.411113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268395+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T14:40:02.268395+0000","last_peered":"2024-04-17T14:40:02.268395+0000","last_clean":"2024-04-17T14:40:02.268395+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T14:40:02.268395+0000","last_undegraded":"2024-04-17T14:40:02.268395+0000","last_fullsized":"2024-04-17T14:40:02.268395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.267793+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T14:40:02.267793+0000","last_peered":"2024-04-17T14:40:02.267793+0000","last_clean":"2024-04-17T14:40:02.267793+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T14:40:02.267793+0000","last_undegraded":"2024-04-17T14:40:02.267793+0000","last_fullsized":"2024-04-17T14:40:02.267793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263246+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T14:40:02.263246+0000","last_peered":"2024-04-17T14:40:02.263246+0000","last_clean":"2024-04-17T14:40:02.263246+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T14:40:02.263246+0000","last_undegraded":"2024-04-17T14:40:02.263246+0000","last_fullsized":"2024-04-17T14:40:02.263246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.075633+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T14:40:01.075633+0000","last_peered":"2024-04-17T14:40:01.075633+0000","last_clean":"2024-04-17T14:40:01.075633+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T14:40:01.075633+0000","last_undegraded":"2024-04-17T14:40:01.075633+0000","last_fullsized":"2024-04-17T14:40:01.075633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411559+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T14:40:02.411559+0000","last_peered":"2024-04-17T14:40:02.411559+0000","last_clean":"2024-04-17T14:40:02.411559+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T14:40:02.411559+0000","last_undegraded":"2024-04-17T14:40:02.411559+0000","last_fullsized":"2024-04-17T14:40:02.411559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411246+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T14:40:02.411246+0000","last_peered":"2024-04-17T14:40:02.411246+0000","last_clean":"2024-04-17T14:40:02.411246+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T14:40:02.411246+0000","last_undegraded":"2024-04-17T14:40:02.411246+0000","last_fullsized":"2024-04-17T14:40:02.411246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411769+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T14:40:02.411769+0000","last_peered":"2024-04-17T14:40:02.411769+0000","last_clean":"2024-04-17T14:40:02.411769+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T14:40:02.411769+0000","last_undegraded":"2024-04-17T14:40:02.411769+0000","last_fullsized":"2024-04-17T14:40:02.411769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410297+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T14:40:02.410297+0000","last_peered":"2024-04-17T14:40:02.410297+0000","last_clean":"2024-04-17T14:40:02.410297+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T14:40:02.410297+0000","last_undegraded":"2024-04-17T14:40:02.410297+0000","last_fullsized":"2024-04-17T14:40:02.410297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411334+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T14:40:02.411334+0000","last_peered":"2024-04-17T14:40:02.411334+0000","last_clean":"2024-04-17T14:40:02.411334+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T14:40:02.411334+0000","last_undegraded":"2024-04-17T14:40:02.411334+0000","last_fullsized":"2024-04-17T14:40:02.411334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410440+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T14:40:02.410440+0000","last_peered":"2024-04-17T14:40:02.410440+0000","last_clean":"2024-04-17T14:40:02.410440+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T14:40:02.410440+0000","last_undegraded":"2024-04-17T14:40:02.410440+0000","last_fullsized":"2024-04-17T14:40:02.410440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.023955+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T14:40:01.023955+0000","last_peered":"2024-04-17T14:40:01.023955+0000","last_clean":"2024-04-17T14:40:01.023955+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T14:40:01.023955+0000","last_undegraded":"2024-04-17T14:40:01.023955+0000","last_fullsized":"2024-04-17T14:40:01.023955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.024230+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T14:40:01.024230+0000","last_peered":"2024-04-17T14:40:01.024230+0000","last_clean":"2024-04-17T14:40:01.024230+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T14:40:01.024230+0000","last_undegraded":"2024-04-17T14:40:01.024230+0000","last_fullsized":"2024-04-17T14:40:01.024230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-17T14:40:01.024081+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T14:40:01.024081+0000","last_peered":"2024-04-17T14:40:01.024081+0000","last_clean":"2024-04-17T14:40:01.024081+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T14:40:01.024081+0000","last_undegraded":"2024-04-17T14:40:01.024081+0000","last_fullsized":"2024-04-17T14:40:01.024081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.269053+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T14:40:02.269053+0000","last_peered":"2024-04-17T14:40:02.269053+0000","last_clean":"2024-04-17T14:40:02.269053+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T14:40:02.269053+0000","last_undegraded":"2024-04-17T14:40:02.269053+0000","last_fullsized":"2024-04-17T14:40:02.269053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":84831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":83129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":84159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":672985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":82603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":667098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T14:40:06.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T14:40:06.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.867+0000 7f1373600640 1 Processor -- start 2024-04-17T14:40:06.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.867+0000 7f1373600640 1 -- start start 2024-04-17T14:40:06.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1373600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f136c153050 0x7f136c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1373600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f136c0c3060 0x7f136c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1373600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f136c153430 con 0x7f136c0c8d20 2024-04-17T14:40:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1373600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f136c06ef10 con 0x7f136c153050 2024-04-17T14:40:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1373600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f136c06ff20 con 0x7f136c0c3060 2024-04-17T14:40:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1370c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f136c153050 0x7f136c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1370c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f136c153050 0x7f136c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47912/0 (socket says 172.21.15.16:47912) 2024-04-17T14:40:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1370c00640 1 -- 172.21.15.16:0/1895457317 learned_addr learned my addr 172.21.15.16:0/1895457317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:06.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.871+0000 7f1363e00640 1 --2- 172.21.15.16:0/1895457317 >> v2:172.21.15.67:3300/0 conn(0x7f136c0c3060 0x7f136c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.875+0000 7f1370c00640 1 -- 172.21.15.16:0/1895457317 >> v2:172.21.15.67:3300/0 conn(0x7f136c0c3060 msgr2=0x7f136c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.875+0000 7f1370c00640 1 --2- 172.21.15.16:0/1895457317 >> v2:172.21.15.67:3300/0 conn(0x7f136c0c3060 0x7f136c0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.875+0000 7f1370c00640 1 -- 172.21.15.16:0/1895457317 >> v1:172.21.15.67:6789/0 conn(0x7f136c0c8d20 legacy=0x7f136c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.875+0000 7f1370c00640 1 -- 172.21.15.16:0/1895457317 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c159cc0 con 0x7f136c153050 2024-04-17T14:40:06.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.879+0000 7f1370c00640 1 --2- 172.21.15.16:0/1895457317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c153050 0x7f136c159780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f136c073d60 tx=0x7f135c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b12d554d6d49fa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:06.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f136be00640 1 -- 172.21.15.16:0/1895457317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0b5070 con 0x7f136c153050 2024-04-17T14:40:06.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f136be00640 1 -- 172.21.15.16:0/1895457317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c0a89d0 con 0x7f136c153050 2024-04-17T14:40:06.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f136be00640 1 -- 172.21.15.16:0/1895457317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0a8da0 con 0x7f136c153050 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- 172.21.15.16:0/1895457317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c153050 msgr2=0x7f136c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- 172.21.15.16:0/1895457317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c153050 0x7f136c159780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f136c073d60 tx=0x7f135c01ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- 172.21.15.16:0/1895457317 shutdown_connections 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- 172.21.15.16:0/1895457317 >> v2:172.21.15.67:3300/0 conn(0x7f136c0c3060 0x7f136c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- 172.21.15.16:0/1895457317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c153050 0x7f136c159780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- 172.21.15.16:0/1895457317 >> 172.21.15.16:0/1895457317 conn(0x7f136c06ba30 msgr2=0x7f136c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:06.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- 172.21.15.16:0/1895457317 shutdown_connections 2024-04-17T14:40:06.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- 172.21.15.16:0/1895457317 wait complete. 2024-04-17T14:40:06.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 Processor -- start 2024-04-17T14:40:06.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- start start 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f136c0c8d20 0x7f136c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f136c153050 0x7f136c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f136c06f440 con 0x7f136c0c3060 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f136c06f160 con 0x7f136c153050 2024-04-17T14:40:06.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.883+0000 7f1373600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f136c06f720 con 0x7f136c0c8d20 2024-04-17T14:40:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.887+0000 7f1370c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.887+0000 7f1370c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47918/0 (socket says 172.21.15.16:47918) 2024-04-17T14:40:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.887+0000 7f1370c00640 1 -- 172.21.15.16:0/826004672 learned_addr learned my addr 172.21.15.16:0/826004672 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.887+0000 7f1371600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f136c153050 0x7f136c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.887+0000 7f1363e00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f136c0c8d20 0x7f136c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:06.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 -- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f136c0c8d20 msgr2=0x7f136c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f136c0c8d20 0x7f136c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 -- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f136c153050 msgr2=0x7f136c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:06.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f136c153050 0x7f136c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:06.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 -- 172.21.15.16:0/826004672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c0ca300 con 0x7f136c0c3060 2024-04-17T14:40:06.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.891+0000 7f1370c00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f135c0b3040 tx=0x7f135c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0b5070 con 0x7f136c0c3060 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c0b0a50 con 0x7f136c0c3060 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c0b0e40 con 0x7f136c0c3060 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c0cca30 con 0x7f136c0c3060 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c0ccff0 con 0x7f136c0c3060 2024-04-17T14:40:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:06.895+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136c076280 con 0x7f136c0c3060 2024-04-17T14:40:07.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.163+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f135c0c2060 con 0x7f136c0c3060 2024-04-17T14:40:07.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.163+0000 7f1369600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 0x7f134806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.163+0000 7f1363e00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 0x7f134806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:07.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.163+0000 7f1363e00640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 0x7f134806a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ca9c0 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:07.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.179+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f135c0f1c20 con 0x7f136c0c3060 2024-04-17T14:40:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.179+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f135c018830 con 0x7f136c0c3060 2024-04-17T14:40:07.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.347+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f136c0c7cb0 con 0x7f1348068400 2024-04-17T14:40:07.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.367+0000 7f1369600640 1 -- 172.21.15.16:0/826004672 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f136c0c7cb0 con 0x7f1348068400 2024-04-17T14:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:07.370 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 msgr2=0x7f134806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 0x7f134806a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ca9c0 tx=0x7f1354008040 comp rx=0 tx=0).stop 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 msgr2=0x7f136c1f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f135c0b3040 tx=0x7f135c01ba70 comp rx=0 tx=0).stop 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 shutdown_connections 2024-04-17T14:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1348068400 0x7f134806a8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f136c153050 0x7f136c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f136c0c8d20 0x7f136c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 --2- 172.21.15.16:0/826004672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f136c0c3060 0x7f136c1f4da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 >> 172.21.15.16:0/826004672 conn(0x7f136c06ba30 msgr2=0x7f136c148fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 shutdown_connections 2024-04-17T14:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.371+0000 7f1373600640 1 -- 172.21.15.16:0/826004672 wait complete. 2024-04-17T14:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-17T14:40:07.002173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235876,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738844,"statfs":{"total":773094113280,"available":772852576256,"internally_reserved":0,"allocated":3121152,"data_stored":1845932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.738725"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411018+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T14:40:02.411018+0000","last_peered":"2024-04-17T14:40:02.411018+0000","last_clean":"2024-04-17T14:40:02.411018+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T14:40:02.411018+0000","last_undegraded":"2024-04-17T14:40:02.411018+0000","last_fullsized":"2024-04-17T14:40:02.411018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.278362+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T14:40:02.278362+0000","last_peered":"2024-04-17T14:40:02.278362+0000","last_clean":"2024-04-17T14:40:02.278362+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T14:40:02.278362+0000","last_undegraded":"2024-04-17T14:40:02.278362+0000","last_fullsized":"2024-04-17T14:40:02.278362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277870+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T14:40:02.277870+0000","last_peered":"2024-04-17T14:40:02.277870+0000","last_clean":"2024-04-17T14:40:02.277870+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T14:40:02.277870+0000","last_undegraded":"2024-04-17T14:40:02.277870+0000","last_fullsized":"2024-04-17T14:40:02.277870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410013+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T14:40:02.410013+0000","last_peered":"2024-04-17T14:40:02.410013+0000","last_clean":"2024-04-17T14:40:02.410013+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T14:40:02.410013+0000","last_undegraded":"2024-04-17T14:40:02.410013+0000","last_fullsized":"2024-04-17T14:40:02.410013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410005+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T14:40:02.410005+0000","last_peered":"2024-04-17T14:40:02.410005+0000","last_clean":"2024-04-17T14:40:02.410005+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T14:40:02.410005+0000","last_undegraded":"2024-04-17T14:40:02.410005+0000","last_fullsized":"2024-04-17T14:40:02.410005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409846+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T14:40:02.409846+0000","last_peered":"2024-04-17T14:40:02.409846+0000","last_clean":"2024-04-17T14:40:02.409846+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T14:40:02.409846+0000","last_undegraded":"2024-04-17T14:40:02.409846+0000","last_fullsized":"2024-04-17T14:40:02.409846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409642+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T14:40:02.409642+0000","last_peered":"2024-04-17T14:40:02.409642+0000","last_clean":"2024-04-17T14:40:02.409642+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T14:40:02.409642+0000","last_undegraded":"2024-04-17T14:40:02.409642+0000","last_fullsized":"2024-04-17T14:40:02.409642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.276634+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T14:40:02.276634+0000","last_peered":"2024-04-17T14:40:02.276634+0000","last_clean":"2024-04-17T14:40:02.276634+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T14:40:02.276634+0000","last_undegraded":"2024-04-17T14:40:02.276634+0000","last_fullsized":"2024-04-17T14:40:02.276634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411264+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T14:40:02.411264+0000","last_peered":"2024-04-17T14:40:02.411264+0000","last_clean":"2024-04-17T14:40:02.411264+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T14:40:02.411264+0000","last_undegraded":"2024-04-17T14:40:02.411264+0000","last_fullsized":"2024-04-17T14:40:02.411264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409793+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T14:40:02.409793+0000","last_peered":"2024-04-17T14:40:02.409793+0000","last_clean":"2024-04-17T14:40:02.409793+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T14:40:02.409793+0000","last_undegraded":"2024-04-17T14:40:02.409793+0000","last_fullsized":"2024-04-17T14:40:02.409793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410244+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T14:40:02.410244+0000","last_peered":"2024-04-17T14:40:02.410244+0000","last_clean":"2024-04-17T14:40:02.410244+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T14:40:02.410244+0000","last_undegraded":"2024-04-17T14:40:02.410244+0000","last_fullsized":"2024-04-17T14:40:02.410244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409932+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T14:40:02.409932+0000","last_peered":"2024-04-17T14:40:02.409932+0000","last_clean":"2024-04-17T14:40:02.409932+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T14:40:02.409932+0000","last_undegraded":"2024-04-17T14:40:02.409932+0000","last_fullsized":"2024-04-17T14:40:02.409932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262572+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T14:40:02.262572+0000","last_peered":"2024-04-17T14:40:02.262572+0000","last_clean":"2024-04-17T14:40:02.262572+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T14:40:02.262572+0000","last_undegraded":"2024-04-17T14:40:02.262572+0000","last_fullsized":"2024-04-17T14:40:02.262572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262633+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T14:40:02.262633+0000","last_peered":"2024-04-17T14:40:02.262633+0000","last_clean":"2024-04-17T14:40:02.262633+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T14:40:02.262633+0000","last_undegraded":"2024-04-17T14:40:02.262633+0000","last_fullsized":"2024-04-17T14:40:02.262633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.276619+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T14:40:02.276619+0000","last_peered":"2024-04-17T14:40:02.276619+0000","last_clean":"2024-04-17T14:40:02.276619+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T14:40:02.276619+0000","last_undegraded":"2024-04-17T14:40:02.276619+0000","last_fullsized":"2024-04-17T14:40:02.276619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410485+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T14:40:02.410485+0000","last_peered":"2024-04-17T14:40:02.410485+0000","last_clean":"2024-04-17T14:40:02.410485+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T14:40:02.410485+0000","last_undegraded":"2024-04-17T14:40:02.410485+0000","last_fullsized":"2024-04-17T14:40:02.410485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411629+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T14:40:02.411629+0000","last_peered":"2024-04-17T14:40:02.411629+0000","last_clean":"2024-04-17T14:40:02.411629+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T14:40:02.411629+0000","last_undegraded":"2024-04-17T14:40:02.411629+0000","last_fullsized":"2024-04-17T14:40:02.411629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413277+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T14:40:02.413277+0000","last_peered":"2024-04-17T14:40:02.413277+0000","last_clean":"2024-04-17T14:40:02.413277+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T14:40:02.413277+0000","last_undegraded":"2024-04-17T14:40:02.413277+0000","last_fullsized":"2024-04-17T14:40:02.413277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411948+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T14:40:02.411948+0000","last_peered":"2024-04-17T14:40:02.411948+0000","last_clean":"2024-04-17T14:40:02.411948+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T14:40:02.411948+0000","last_undegraded":"2024-04-17T14:40:02.411948+0000","last_fullsized":"2024-04-17T14:40:02.411948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410015+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T14:40:02.410015+0000","last_peered":"2024-04-17T14:40:02.410015+0000","last_clean":"2024-04-17T14:40:02.410015+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T14:40:02.410015+0000","last_undegraded":"2024-04-17T14:40:02.410015+0000","last_fullsized":"2024-04-17T14:40:02.410015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268563+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T14:40:02.268563+0000","last_peered":"2024-04-17T14:40:02.268563+0000","last_clean":"2024-04-17T14:40:02.268563+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T14:40:02.268563+0000","last_undegraded":"2024-04-17T14:40:02.268563+0000","last_fullsized":"2024-04-17T14:40:02.268563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410840+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T14:40:02.410840+0000","last_peered":"2024-04-17T14:40:02.410840+0000","last_clean":"2024-04-17T14:40:02.410840+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T14:40:02.410840+0000","last_undegraded":"2024-04-17T14:40:02.410840+0000","last_fullsized":"2024-04-17T14:40:02.410840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.276906+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T14:40:02.276906+0000","last_peered":"2024-04-17T14:40:02.276906+0000","last_clean":"2024-04-17T14:40:02.276906+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T14:40:02.276906+0000","last_undegraded":"2024-04-17T14:40:02.276906+0000","last_fullsized":"2024-04-17T14:40:02.276906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410554+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T14:40:02.410554+0000","last_peered":"2024-04-17T14:40:02.410554+0000","last_clean":"2024-04-17T14:40:02.410554+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T14:40:02.410554+0000","last_undegraded":"2024-04-17T14:40:02.410554+0000","last_fullsized":"2024-04-17T14:40:02.410554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277195+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T14:40:02.277195+0000","last_peered":"2024-04-17T14:40:02.277195+0000","last_clean":"2024-04-17T14:40:02.277195+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T14:40:02.277195+0000","last_undegraded":"2024-04-17T14:40:02.277195+0000","last_fullsized":"2024-04-17T14:40:02.277195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410050+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T14:40:02.410050+0000","last_peered":"2024-04-17T14:40:02.410050+0000","last_clean":"2024-04-17T14:40:02.410050+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T14:40:02.410050+0000","last_undegraded":"2024-04-17T14:40:02.410050+0000","last_fullsized":"2024-04-17T14:40:02.410050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263613+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T14:40:02.263613+0000","last_peered":"2024-04-17T14:40:02.263613+0000","last_clean":"2024-04-17T14:40:02.263613+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T14:40:02.263613+0000","last_undegraded":"2024-04-17T14:40:02.263613+0000","last_fullsized":"2024-04-17T14:40:02.263613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262588+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T14:40:02.262588+0000","last_peered":"2024-04-17T14:40:02.262588+0000","last_clean":"2024-04-17T14:40:02.262588+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T14:40:02.262588+0000","last_undegraded":"2024-04-17T14:40:02.262588+0000","last_fullsized":"2024-04-17T14:40:02.262588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277203+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T14:40:02.277203+0000","last_peered":"2024-04-17T14:40:02.277203+0000","last_clean":"2024-04-17T14:40:02.277203+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T14:40:02.277203+0000","last_undegraded":"2024-04-17T14:40:02.277203+0000","last_fullsized":"2024-04-17T14:40:02.277203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411149+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T14:40:02.411149+0000","last_peered":"2024-04-17T14:40:02.411149+0000","last_clean":"2024-04-17T14:40:02.411149+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T14:40:02.411149+0000","last_undegraded":"2024-04-17T14:40:02.411149+0000","last_fullsized":"2024-04-17T14:40:02.411149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413079+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T14:40:02.413079+0000","last_peered":"2024-04-17T14:40:02.413079+0000","last_clean":"2024-04-17T14:40:02.413079+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T14:40:02.413079+0000","last_undegraded":"2024-04-17T14:40:02.413079+0000","last_fullsized":"2024-04-17T14:40:02.413079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409384+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T14:40:02.409384+0000","last_peered":"2024-04-17T14:40:02.409384+0000","last_clean":"2024-04-17T14:40:02.409384+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T14:40:02.409384+0000","last_undegraded":"2024-04-17T14:40:02.409384+0000","last_fullsized":"2024-04-17T14:40:02.409384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410914+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T14:40:02.410914+0000","last_peered":"2024-04-17T14:40:02.410914+0000","last_clean":"2024-04-17T14:40:02.410914+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T14:40:02.410914+0000","last_undegraded":"2024-04-17T14:40:02.410914+0000","last_fullsized":"2024-04-17T14:40:02.410914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277492+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T14:40:02.277492+0000","last_peered":"2024-04-17T14:40:02.277492+0000","last_clean":"2024-04-17T14:40:02.277492+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T14:40:02.277492+0000","last_undegraded":"2024-04-17T14:40:02.277492+0000","last_fullsized":"2024-04-17T14:40:02.277492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268827+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T14:40:02.268827+0000","last_peered":"2024-04-17T14:40:02.268827+0000","last_clean":"2024-04-17T14:40:02.268827+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T14:40:02.268827+0000","last_undegraded":"2024-04-17T14:40:02.268827+0000","last_fullsized":"2024-04-17T14:40:02.268827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411298+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T14:40:02.411298+0000","last_peered":"2024-04-17T14:40:02.411298+0000","last_clean":"2024-04-17T14:40:02.411298+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T14:40:02.411298+0000","last_undegraded":"2024-04-17T14:40:02.411298+0000","last_fullsized":"2024-04-17T14:40:02.411298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262350+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T14:40:02.262350+0000","last_peered":"2024-04-17T14:40:02.262350+0000","last_clean":"2024-04-17T14:40:02.262350+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T14:40:02.262350+0000","last_undegraded":"2024-04-17T14:40:02.262350+0000","last_fullsized":"2024-04-17T14:40:02.262350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277256+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T14:40:02.277256+0000","last_peered":"2024-04-17T14:40:02.277256+0000","last_clean":"2024-04-17T14:40:02.277256+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T14:40:02.277256+0000","last_undegraded":"2024-04-17T14:40:02.277256+0000","last_fullsized":"2024-04-17T14:40:02.277256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411097+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T14:40:02.411097+0000","last_peered":"2024-04-17T14:40:02.411097+0000","last_clean":"2024-04-17T14:40:02.411097+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T14:40:02.411097+0000","last_undegraded":"2024-04-17T14:40:02.411097+0000","last_fullsized":"2024-04-17T14:40:02.411097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268137+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T14:40:02.268137+0000","last_peered":"2024-04-17T14:40:02.268137+0000","last_clean":"2024-04-17T14:40:02.268137+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T14:40:02.268137+0000","last_undegraded":"2024-04-17T14:40:02.268137+0000","last_fullsized":"2024-04-17T14:40:02.268137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411460+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T14:40:02.411460+0000","last_peered":"2024-04-17T14:40:02.411460+0000","last_clean":"2024-04-17T14:40:02.411460+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T14:40:02.411460+0000","last_undegraded":"2024-04-17T14:40:02.411460+0000","last_fullsized":"2024-04-17T14:40:02.411460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410071+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T14:40:02.410071+0000","last_peered":"2024-04-17T14:40:02.410071+0000","last_clean":"2024-04-17T14:40:02.410071+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T14:40:02.410071+0000","last_undegraded":"2024-04-17T14:40:02.410071+0000","last_fullsized":"2024-04-17T14:40:02.410071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409948+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T14:40:02.409948+0000","last_peered":"2024-04-17T14:40:02.409948+0000","last_clean":"2024-04-17T14:40:02.409948+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T14:40:02.409948+0000","last_undegraded":"2024-04-17T14:40:02.409948+0000","last_fullsized":"2024-04-17T14:40:02.409948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277469+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T14:40:02.277469+0000","last_peered":"2024-04-17T14:40:02.277469+0000","last_clean":"2024-04-17T14:40:02.277469+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T14:40:02.277469+0000","last_undegraded":"2024-04-17T14:40:02.277469+0000","last_fullsized":"2024-04-17T14:40:02.277469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413650+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T14:40:02.413650+0000","last_peered":"2024-04-17T14:40:02.413650+0000","last_clean":"2024-04-17T14:40:02.413650+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T14:40:02.413650+0000","last_undegraded":"2024-04-17T14:40:02.413650+0000","last_fullsized":"2024-04-17T14:40:02.413650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411563+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T14:40:02.411563+0000","last_peered":"2024-04-17T14:40:02.411563+0000","last_clean":"2024-04-17T14:40:02.411563+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T14:40:02.411563+0000","last_undegraded":"2024-04-17T14:40:02.411563+0000","last_fullsized":"2024-04-17T14:40:02.411563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410106+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T14:40:02.410106+0000","last_peered":"2024-04-17T14:40:02.410106+0000","last_clean":"2024-04-17T14:40:02.410106+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T14:40:02.410106+0000","last_undegraded":"2024-04-17T14:40:02.410106+0000","last_fullsized":"2024-04-17T14:40:02.410106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410341+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T14:40:02.410341+0000","last_peered":"2024-04-17T14:40:02.410341+0000","last_clean":"2024-04-17T14:40:02.410341+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T14:40:02.410341+0000","last_undegraded":"2024-04-17T14:40:02.410341+0000","last_fullsized":"2024-04-17T14:40:02.410341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413460+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T14:40:02.413460+0000","last_peered":"2024-04-17T14:40:02.413460+0000","last_clean":"2024-04-17T14:40:02.413460+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T14:40:02.413460+0000","last_undegraded":"2024-04-17T14:40:02.413460+0000","last_fullsized":"2024-04-17T14:40:02.413460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262885+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T14:40:02.262885+0000","last_peered":"2024-04-17T14:40:02.262885+0000","last_clean":"2024-04-17T14:40:02.262885+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T14:40:02.262885+0000","last_undegraded":"2024-04-17T14:40:02.262885+0000","last_fullsized":"2024-04-17T14:40:02.262885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411399+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T14:40:02.411399+0000","last_peered":"2024-04-17T14:40:02.411399+0000","last_clean":"2024-04-17T14:40:02.411399+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T14:40:02.411399+0000","last_undegraded":"2024-04-17T14:40:02.411399+0000","last_fullsized":"2024-04-17T14:40:02.411399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411503+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T14:40:02.411503+0000","last_peered":"2024-04-17T14:40:02.411503+0000","last_clean":"2024-04-17T14:40:02.411503+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T14:40:02.411503+0000","last_undegraded":"2024-04-17T14:40:02.411503+0000","last_fullsized":"2024-04-17T14:40:02.411503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409638+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T14:40:02.409638+0000","last_peered":"2024-04-17T14:40:02.409638+0000","last_clean":"2024-04-17T14:40:02.409638+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T14:40:02.409638+0000","last_undegraded":"2024-04-17T14:40:02.409638+0000","last_fullsized":"2024-04-17T14:40:02.409638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410778+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T14:40:02.410778+0000","last_peered":"2024-04-17T14:40:02.410778+0000","last_clean":"2024-04-17T14:40:02.410778+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T14:40:02.410778+0000","last_undegraded":"2024-04-17T14:40:02.410778+0000","last_fullsized":"2024-04-17T14:40:02.410778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.267791+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T14:40:02.267791+0000","last_peered":"2024-04-17T14:40:02.267791+0000","last_clean":"2024-04-17T14:40:02.267791+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T14:40:02.267791+0000","last_undegraded":"2024-04-17T14:40:02.267791+0000","last_fullsized":"2024-04-17T14:40:02.267791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411023+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T14:40:02.411023+0000","last_peered":"2024-04-17T14:40:02.411023+0000","last_clean":"2024-04-17T14:40:02.411023+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T14:40:02.411023+0000","last_undegraded":"2024-04-17T14:40:02.411023+0000","last_fullsized":"2024-04-17T14:40:02.411023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411263+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T14:40:02.411263+0000","last_peered":"2024-04-17T14:40:02.411263+0000","last_clean":"2024-04-17T14:40:02.411263+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T14:40:02.411263+0000","last_undegraded":"2024-04-17T14:40:02.411263+0000","last_fullsized":"2024-04-17T14:40:02.411263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410136+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T14:40:02.410136+0000","last_peered":"2024-04-17T14:40:02.410136+0000","last_clean":"2024-04-17T14:40:02.410136+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T14:40:02.410136+0000","last_undegraded":"2024-04-17T14:40:02.410136+0000","last_fullsized":"2024-04-17T14:40:02.410136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268964+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T14:40:02.268964+0000","last_peered":"2024-04-17T14:40:02.268964+0000","last_clean":"2024-04-17T14:40:02.268964+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T14:40:02.268964+0000","last_undegraded":"2024-04-17T14:40:02.268964+0000","last_fullsized":"2024-04-17T14:40:02.268964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411102+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T14:40:02.411102+0000","last_peered":"2024-04-17T14:40:02.411102+0000","last_clean":"2024-04-17T14:40:02.411102+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T14:40:02.411102+0000","last_undegraded":"2024-04-17T14:40:02.411102+0000","last_fullsized":"2024-04-17T14:40:02.411102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.278074+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T14:40:02.278074+0000","last_peered":"2024-04-17T14:40:02.278074+0000","last_clean":"2024-04-17T14:40:02.278074+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T14:40:02.278074+0000","last_undegraded":"2024-04-17T14:40:02.278074+0000","last_fullsized":"2024-04-17T14:40:02.278074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410093+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T14:40:02.410093+0000","last_peered":"2024-04-17T14:40:02.410093+0000","last_clean":"2024-04-17T14:40:02.410093+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T14:40:02.410093+0000","last_undegraded":"2024-04-17T14:40:02.410093+0000","last_fullsized":"2024-04-17T14:40:02.410093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263065+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T14:40:02.263065+0000","last_peered":"2024-04-17T14:40:02.263065+0000","last_clean":"2024-04-17T14:40:02.263065+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T14:40:02.263065+0000","last_undegraded":"2024-04-17T14:40:02.263065+0000","last_fullsized":"2024-04-17T14:40:02.263065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411856+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T14:40:02.411856+0000","last_peered":"2024-04-17T14:40:02.411856+0000","last_clean":"2024-04-17T14:40:02.411856+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T14:40:02.411856+0000","last_undegraded":"2024-04-17T14:40:02.411856+0000","last_fullsized":"2024-04-17T14:40:02.411856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410886+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T14:40:02.410886+0000","last_peered":"2024-04-17T14:40:02.410886+0000","last_clean":"2024-04-17T14:40:02.410886+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T14:40:02.410886+0000","last_undegraded":"2024-04-17T14:40:02.410886+0000","last_fullsized":"2024-04-17T14:40:02.410886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411627+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T14:40:02.411627+0000","last_peered":"2024-04-17T14:40:02.411627+0000","last_clean":"2024-04-17T14:40:02.411627+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T14:40:02.411627+0000","last_undegraded":"2024-04-17T14:40:02.411627+0000","last_fullsized":"2024-04-17T14:40:02.411627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268440+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T14:40:02.268440+0000","last_peered":"2024-04-17T14:40:02.268440+0000","last_clean":"2024-04-17T14:40:02.268440+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T14:40:02.268440+0000","last_undegraded":"2024-04-17T14:40:02.268440+0000","last_fullsized":"2024-04-17T14:40:02.268440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411143+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T14:40:02.411143+0000","last_peered":"2024-04-17T14:40:02.411143+0000","last_clean":"2024-04-17T14:40:02.411143+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T14:40:02.411143+0000","last_undegraded":"2024-04-17T14:40:02.411143+0000","last_fullsized":"2024-04-17T14:40:02.411143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262229+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T14:40:02.262229+0000","last_peered":"2024-04-17T14:40:02.262229+0000","last_clean":"2024-04-17T14:40:02.262229+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T14:40:02.262229+0000","last_undegraded":"2024-04-17T14:40:02.262229+0000","last_fullsized":"2024-04-17T14:40:02.262229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413117+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T14:40:02.413117+0000","last_peered":"2024-04-17T14:40:02.413117+0000","last_clean":"2024-04-17T14:40:02.413117+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T14:40:02.413117+0000","last_undegraded":"2024-04-17T14:40:02.413117+0000","last_fullsized":"2024-04-17T14:40:02.413117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.276891+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T14:40:02.276891+0000","last_peered":"2024-04-17T14:40:02.276891+0000","last_clean":"2024-04-17T14:40:02.276891+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T14:40:02.276891+0000","last_undegraded":"2024-04-17T14:40:02.276891+0000","last_fullsized":"2024-04-17T14:40:02.276891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411479+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T14:40:02.411479+0000","last_peered":"2024-04-17T14:40:02.411479+0000","last_clean":"2024-04-17T14:40:02.411479+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T14:40:02.411479+0000","last_undegraded":"2024-04-17T14:40:02.411479+0000","last_fullsized":"2024-04-17T14:40:02.411479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409655+0000","last_change":"2024-04-17T14:39:59.452343+0000","last_active":"2024-04-17T14:40:02.409655+0000","last_peered":"2024-04-17T14:40:02.409655+0000","last_clean":"2024-04-17T14:40:02.409655+0000","last_became_active":"2024-04-17T14:39:59.449792+0000","last_became_peered":"2024-04-17T14:39:59.449792+0000","last_unstale":"2024-04-17T14:40:02.409655+0000","last_undegraded":"2024-04-17T14:40:02.409655+0000","last_fullsized":"2024-04-17T14:40:02.409655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277794+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T14:40:02.277794+0000","last_peered":"2024-04-17T14:40:02.277794+0000","last_clean":"2024-04-17T14:40:02.277794+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T14:40:02.277794+0000","last_undegraded":"2024-04-17T14:40:02.277794+0000","last_fullsized":"2024-04-17T14:40:02.277794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410680+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T14:40:02.410680+0000","last_peered":"2024-04-17T14:40:02.410680+0000","last_clean":"2024-04-17T14:40:02.410680+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T14:40:02.410680+0000","last_undegraded":"2024-04-17T14:40:02.410680+0000","last_fullsized":"2024-04-17T14:40:02.410680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411997+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T14:40:02.411997+0000","last_peered":"2024-04-17T14:40:02.411997+0000","last_clean":"2024-04-17T14:40:02.411997+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T14:40:02.411997+0000","last_undegraded":"2024-04-17T14:40:02.411997+0000","last_fullsized":"2024-04-17T14:40:02.411997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.262815+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T14:40:02.262815+0000","last_peered":"2024-04-17T14:40:02.262815+0000","last_clean":"2024-04-17T14:40:02.262815+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T14:40:02.262815+0000","last_undegraded":"2024-04-17T14:40:02.262815+0000","last_fullsized":"2024-04-17T14:40:02.262815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.269244+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T14:40:02.269244+0000","last_peered":"2024-04-17T14:40:02.269244+0000","last_clean":"2024-04-17T14:40:02.269244+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T14:40:02.269244+0000","last_undegraded":"2024-04-17T14:40:02.269244+0000","last_fullsized":"2024-04-17T14:40:02.269244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268660+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T14:40:02.268660+0000","last_peered":"2024-04-17T14:40:02.268660+0000","last_clean":"2024-04-17T14:40:02.268660+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T14:40:02.268660+0000","last_undegraded":"2024-04-17T14:40:02.268660+0000","last_fullsized":"2024-04-17T14:40:02.268660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411605+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T14:40:02.411605+0000","last_peered":"2024-04-17T14:40:02.411605+0000","last_clean":"2024-04-17T14:40:02.411605+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T14:40:02.411605+0000","last_undegraded":"2024-04-17T14:40:02.411605+0000","last_fullsized":"2024-04-17T14:40:02.411605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268719+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T14:40:02.268719+0000","last_peered":"2024-04-17T14:40:02.268719+0000","last_clean":"2024-04-17T14:40:02.268719+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T14:40:02.268719+0000","last_undegraded":"2024-04-17T14:40:02.268719+0000","last_fullsized":"2024-04-17T14:40:02.268719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.409576+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T14:40:02.409576+0000","last_peered":"2024-04-17T14:40:02.409576+0000","last_clean":"2024-04-17T14:40:02.409576+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T14:40:02.409576+0000","last_undegraded":"2024-04-17T14:40:02.409576+0000","last_fullsized":"2024-04-17T14:40:02.409576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411113+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T14:40:02.411113+0000","last_peered":"2024-04-17T14:40:02.411113+0000","last_clean":"2024-04-17T14:40:02.411113+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T14:40:02.411113+0000","last_undegraded":"2024-04-17T14:40:02.411113+0000","last_fullsized":"2024-04-17T14:40:02.411113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.268395+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T14:40:02.268395+0000","last_peered":"2024-04-17T14:40:02.268395+0000","last_clean":"2024-04-17T14:40:02.268395+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T14:40:02.268395+0000","last_undegraded":"2024-04-17T14:40:02.268395+0000","last_fullsized":"2024-04-17T14:40:02.268395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.267793+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T14:40:02.267793+0000","last_peered":"2024-04-17T14:40:02.267793+0000","last_clean":"2024-04-17T14:40:02.267793+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T14:40:02.267793+0000","last_undegraded":"2024-04-17T14:40:02.267793+0000","last_fullsized":"2024-04-17T14:40:02.267793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.263246+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T14:40:02.263246+0000","last_peered":"2024-04-17T14:40:02.263246+0000","last_clean":"2024-04-17T14:40:02.263246+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T14:40:02.263246+0000","last_undegraded":"2024-04-17T14:40:02.263246+0000","last_fullsized":"2024-04-17T14:40:02.263246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.413298+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T14:40:02.413298+0000","last_peered":"2024-04-17T14:40:02.413298+0000","last_clean":"2024-04-17T14:40:02.413298+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T14:40:02.413298+0000","last_undegraded":"2024-04-17T14:40:02.413298+0000","last_fullsized":"2024-04-17T14:40:02.413298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411559+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T14:40:02.411559+0000","last_peered":"2024-04-17T14:40:02.411559+0000","last_clean":"2024-04-17T14:40:02.411559+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T14:40:02.411559+0000","last_undegraded":"2024-04-17T14:40:02.411559+0000","last_fullsized":"2024-04-17T14:40:02.411559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411246+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T14:40:02.411246+0000","last_peered":"2024-04-17T14:40:02.411246+0000","last_clean":"2024-04-17T14:40:02.411246+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T14:40:02.411246+0000","last_undegraded":"2024-04-17T14:40:02.411246+0000","last_fullsized":"2024-04-17T14:40:02.411246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411769+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T14:40:02.411769+0000","last_peered":"2024-04-17T14:40:02.411769+0000","last_clean":"2024-04-17T14:40:02.411769+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T14:40:02.411769+0000","last_undegraded":"2024-04-17T14:40:02.411769+0000","last_fullsized":"2024-04-17T14:40:02.411769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410297+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T14:40:02.410297+0000","last_peered":"2024-04-17T14:40:02.410297+0000","last_clean":"2024-04-17T14:40:02.410297+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T14:40:02.410297+0000","last_undegraded":"2024-04-17T14:40:02.410297+0000","last_fullsized":"2024-04-17T14:40:02.410297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.411334+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T14:40:02.411334+0000","last_peered":"2024-04-17T14:40:02.411334+0000","last_clean":"2024-04-17T14:40:02.411334+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T14:40:02.411334+0000","last_undegraded":"2024-04-17T14:40:02.411334+0000","last_fullsized":"2024-04-17T14:40:02.411334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.410440+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T14:40:02.410440+0000","last_peered":"2024-04-17T14:40:02.410440+0000","last_clean":"2024-04-17T14:40:02.410440+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T14:40:02.410440+0000","last_undegraded":"2024-04-17T14:40:02.410440+0000","last_fullsized":"2024-04-17T14:40:02.410440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.277375+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T14:40:02.277375+0000","last_peered":"2024-04-17T14:40:02.277375+0000","last_clean":"2024-04-17T14:40:02.277375+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T14:40:02.277375+0000","last_undegraded":"2024-04-17T14:40:02.277375+0000","last_fullsized":"2024-04-17T14:40:02.277375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.279058+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T14:40:02.279058+0000","last_peered":"2024-04-17T14:40:02.279058+0000","last_clean":"2024-04-17T14:40:02.279058+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T14:40:02.279058+0000","last_undegraded":"2024-04-17T14:40:02.279058+0000","last_fullsized":"2024-04-17T14:40:02.279058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.278602+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T14:40:02.278602+0000","last_peered":"2024-04-17T14:40:02.278602+0000","last_clean":"2024-04-17T14:40:02.278602+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T14:40:02.278602+0000","last_undegraded":"2024-04-17T14:40:02.278602+0000","last_fullsized":"2024-04-17T14:40:02.278602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-17T14:40:02.269053+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T14:40:02.269053+0000","last_peered":"2024-04-17T14:40:02.269053+0000","last_clean":"2024-04-17T14:40:02.269053+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T14:40:02.269053+0000","last_undegraded":"2024-04-17T14:40:02.269053+0000","last_fullsized":"2024-04-17T14:40:02.269053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":84831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":83129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":84159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":672985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":82603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":82671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":673007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T14:40:07.398 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T14:40:07.399 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T14:40:07.399 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T14:40:07.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T14:40:07.399 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T14:40:07.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.579+0000 7f89da000640 1 Processor -- start 2024-04-17T14:40:07.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.579+0000 7f89da000640 1 -- start start 2024-04-17T14:40:07.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.579+0000 7f89da000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89d40cb570 0x7f89d415b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.579+0000 7f89da000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40c94a0 0x7f89d40b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89da000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40c3710 con 0x7f89d40cb190 2024-04-17T14:40:07.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89da000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f89d415be90 con 0x7f89d40cb570 2024-04-17T14:40:07.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89da000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40c34c0 con 0x7f89d40c94a0 2024-04-17T14:40:07.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89cbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89d40cb570 0x7f89d415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:07.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89cbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89d40cb570 0x7f89d415b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48528/0 (socket says 172.21.15.16:48528) 2024-04-17T14:40:07.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.583+0000 7f89cbe00640 1 -- 172.21.15.16:0/3676910318 learned_addr learned my addr 172.21.15.16:0/3676910318 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.591+0000 7f89cbe00640 1 -- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40c94a0 msgr2=0x7f89d40b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.591+0000 7f89cbe00640 1 --2- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40c94a0 0x7f89d40b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.591+0000 7f89cbe00640 1 -- 172.21.15.16:0/3676910318 >> v1:172.21.15.16:6789/0 conn(0x7f89d40cb190 legacy=0x7f89d40b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.591+0000 7f89cbe00640 1 -- 172.21.15.16:0/3676910318 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40c39f0 con 0x7f89d40cb570 2024-04-17T14:40:07.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.595+0000 7f89cbe00640 1 --2- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d415b950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf9802982b71680 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89d2a00640 1 -- 172.21.15.16:0/3676910318 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b0070 con 0x7f89d40cb570 2024-04-17T14:40:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89d2a00640 1 -- 172.21.15.16:0/3676910318 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0ab600 con 0x7f89d40cb570 2024-04-17T14:40:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89d2a00640 1 -- 172.21.15.16:0/3676910318 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0ab9d0 con 0x7f89d40cb570 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 -- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 msgr2=0x7f89d415b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 --2- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d415b950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc01c520 comp rx=0 tx=0).stop 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 -- 172.21.15.16:0/3676910318 shutdown_connections 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 --2- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40c94a0 0x7f89d40b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 --2- 172.21.15.16:0/3676910318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d415b950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 -- 172.21.15.16:0/3676910318 >> 172.21.15.16:0/3676910318 conn(0x7f89d4062850 msgr2=0x7f89d406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 -- 172.21.15.16:0/3676910318 shutdown_connections 2024-04-17T14:40:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.603+0000 7f89da000640 1 -- 172.21.15.16:0/3676910318 wait complete. 2024-04-17T14:40:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 Processor -- start 2024-04-17T14:40:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 -- start start 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d40c94a0 0x7f89d40c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40cb190 0x7f89d4152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40c9910 con 0x7f89d40c94a0 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40c3cd0 con 0x7f89d40cb570 2024-04-17T14:40:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.607+0000 7f89da000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40c9a90 con 0x7f89d40cb190 2024-04-17T14:40:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.611+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:07.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.611+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48534/0 (socket says 172.21.15.16:48534) 2024-04-17T14:40:07.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.611+0000 7f89d3e00640 1 -- 172.21.15.16:0/3156348930 learned_addr learned my addr 172.21.15.16:0/3156348930 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:07.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.619+0000 7f89d3400640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d40c94a0 0x7f89d40c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:07.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.619+0000 7f89cbe00640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40cb190 0x7f89d4152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:07.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.623+0000 7f89d3e00640 1 -- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40cb190 msgr2=0x7f89d4152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:07.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.623+0000 7f89d3e00640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40cb190 0x7f89d4152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.623+0000 7f89d3e00640 1 -- 172.21.15.16:0/3156348930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d40c94a0 msgr2=0x7f89d40c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:07.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.623+0000 7f89d3e00640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d40c94a0 0x7f89d40c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:07.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.623+0000 7f89d3e00640 1 -- 172.21.15.16:0/3156348930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d41f4f20 con 0x7f89d40cb570 2024-04-17T14:40:07.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.631+0000 7f89d3e00640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b9a0 tx=0x7f89cc00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc019070 con 0x7f89d40cb570 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc00cbc0 con 0x7f89d40cb570 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc014440 con 0x7f89d40cb570 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d40c74d0 con 0x7f89d40cb570 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d40c7a90 con 0x7f89d40cb570 2024-04-17T14:40:07.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:07.647+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d4076280 con 0x7f89d40cb570 2024-04-17T14:40:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.135+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89cc01c070 con 0x7f89d40cb570 2024-04-17T14:40:08.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.135+0000 7f89cb400640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 0x7f89b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.135+0000 7f89d3400640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 0x7f89b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.135+0000 7f89d3400640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 0x7f89b006a890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89c400b810 tx=0x7f89c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.143+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f89cc054ae0 con 0x7f89d40cb570 2024-04-17T14:40:08.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.175+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f89cc023020 con 0x7f89d40cb570 2024-04-17T14:40:08.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.383+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f89d40ca000 con 0x7f89d40cb570 2024-04-17T14:40:08.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.595+0000 7f89cb400640 1 -- 172.21.15.16:0/3156348930 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168083 (secure 0 0 0) 0x7f89cc057140 con 0x7f89d40cb570 2024-04-17T14:40:08.597 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:08.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 msgr2=0x7f89b006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 0x7f89b006a890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89c400b810 tx=0x7f89c4008040 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 msgr2=0x7f89d40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b9a0 tx=0x7f89cc00be60 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 shutdown_connections 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f89b00683d0 0x7f89b006a890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89d40cb570 0x7f89d40c8290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89d40cb190 0x7f89d4152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 --2- 172.21.15.16:0/3156348930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d40c94a0 0x7f89d40c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 >> 172.21.15.16:0/3156348930 conn(0x7f89d4062850 msgr2=0x7f89d40ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 shutdown_connections 2024-04-17T14:40:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.599+0000 7f89da000640 1 -- 172.21.15.16:0/3156348930 wait complete. 2024-04-17T14:40:08.617 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3551347273},{"type":"v1","addr":"172.21.15.67:6801","nonce":3551347273}]},"active_addr":"172.21.15.67:6801/3551347273","active_change":"2024-04-17T14:39:06.592345+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":2817197819}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1571632125}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":432825391}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":998289747}]}]} 2024-04-17T14:40:08.620 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T14:40:08.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T14:40:08.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:08.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 Processor -- start 2024-04-17T14:40:08.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 -- start start 2024-04-17T14:40:08.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdc2c073a40 0x7fdc2c1643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c159550 con 0x7fdc2c1529d0 2024-04-17T14:40:08.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2c159830 con 0x7fdc2c073530 2024-04-17T14:40:08.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc32200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2c06cd90 con 0x7fdc2c073a40 2024-04-17T14:40:08.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc2b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdc2c1529d0 0x7fdc2c0c7c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35666/0 (socket says 172.21.15.16:35666) 2024-04-17T14:40:08.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc2b400640 1 -- 172.21.15.16:0/3114345511 learned_addr learned my addr 172.21.15.16:0/3114345511 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:08.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.763+0000 7fdc2be00640 1 --2- 172.21.15.16:0/3114345511 >> v2:172.21.15.67:3300/0 conn(0x7fdc2c073a40 0x7fdc2c1643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.767+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660330243 0 0) 0x7fdc2c159550 con 0x7fdc2c1529d0 2024-04-17T14:40:08.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.767+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc10003530 con 0x7fdc2c1529d0 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2619205036 0 0) 0x7fdc10003530 con 0x7fdc2c1529d0 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 >> v2:172.21.15.67:3300/0 conn(0x7fdc2c073a40 msgr2=0x7fdc2c1643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 --2- 172.21.15.16:0/3114345511 >> v2:172.21.15.67:3300/0 conn(0x7fdc2c073a40 0x7fdc2c1643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 >> v1:172.21.15.67:6789/0 conn(0x7fdc2c073530 legacy=0x7fdc2c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c06cfe0 con 0x7fdc2c1529d0 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fdc1c001a00 con 0x7fdc2c1529d0 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 >> v1:172.21.15.16:6789/0 conn(0x7fdc2c1529d0 legacy=0x7fdc2c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc10003a10 0x7fdc10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 0x7fdc10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10005220 0x7fdc1000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c06cd90 con 0x7fdc10004810 2024-04-17T14:40:08.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1000c150 con 0x7fdc10005220 2024-04-17T14:40:08.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1000c350 con 0x7fdc10003a10 2024-04-17T14:40:08.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.771+0000 7fdc2b400640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc10003a10 0x7fdc10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 0x7fdc10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 -- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc10003a10 msgr2=0x7fdc10003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc10003a10 0x7fdc10003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 -- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10005220 msgr2=0x7fdc1000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10005220 0x7fdc1000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc22a00640 1 -- 172.21.15.16:0/3114345511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc10003530 con 0x7fdc10004810 2024-04-17T14:40:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.775+0000 7fdc2be00640 1 -- 172.21.15.16:0/3114345511 reap_dead start 2024-04-17T14:40:08.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.779+0000 7fdc22a00640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 0x7fdc10004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc14003db0 tx=0x7fdc1401c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47338773f337d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:08.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140b1070 con 0x7fdc10004810 2024-04-17T14:40:08.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc140ac440 con 0x7fdc10004810 2024-04-17T14:40:08.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc2aa00640 1 -- 172.21.15.16:0/3114345511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140039b0 con 0x7fdc10004810 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 -- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 msgr2=0x7fdc10004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 0x7fdc10004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc14003db0 tx=0x7fdc1401c2c0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 -- 172.21.15.16:0/3114345511 shutdown_connections 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 --2- 172.21.15.16:0/3114345511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc10004810 0x7fdc10004c90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 -- 172.21.15.16:0/3114345511 >> 172.21.15.16:0/3114345511 conn(0x7fdc2c072a10 msgr2=0x7fdc2c072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 -- 172.21.15.16:0/3114345511 shutdown_connections 2024-04-17T14:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.783+0000 7fdc32200640 1 -- 172.21.15.16:0/3114345511 wait complete. 2024-04-17T14:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 Processor -- start 2024-04-17T14:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 -- start start 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10004810 0x7fdc2c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc2c14e850 0x7fdc2c0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c0c7610 con 0x7fdc2c155fb0 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c070d70 con 0x7fdc10004810 2024-04-17T14:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc32200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2c0c7790 con 0x7fdc2c14e850 2024-04-17T14:40:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc22a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc22a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47934/0 (socket says 172.21.15.16:47934) 2024-04-17T14:40:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.787+0000 7fdc22a00640 1 -- 172.21.15.16:0/2097174860 learned_addr learned my addr 172.21.15.16:0/2097174860 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc2be00640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc2c14e850 0x7fdc2c0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc22a00640 1 -- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc2c14e850 msgr2=0x7fdc2c0c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc22a00640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc2c14e850 0x7fdc2c0c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc22a00640 1 -- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10004810 msgr2=0x7fdc2c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:08.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc22a00640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10004810 0x7fdc2c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:08.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.791+0000 7fdc22a00640 1 -- 172.21.15.16:0/2097174860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c1517b0 con 0x7fdc2c155fb0 2024-04-17T14:40:08.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.795+0000 7fdc22a00640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc140979a0 tx=0x7fdc10005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:08.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140b1040 con 0x7fdc2c155fb0 2024-04-17T14:40:08.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc140ace50 con 0x7fdc2c155fb0 2024-04-17T14:40:08.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140b5650 con 0x7fdc2c155fb0 2024-04-17T14:40:08.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c0c6780 con 0x7fdc2c155fb0 2024-04-17T14:40:08.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c151f70 con 0x7fdc2c155fb0 2024-04-17T14:40:08.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.799+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c076280 con 0x7fdc2c155fb0 2024-04-17T14:40:08.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.823+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc140b57f0 con 0x7fdc2c155fb0 2024-04-17T14:40:08.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.823+0000 7fdc23e00640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 0x7fdc0806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:08.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.823+0000 7fdc2b400640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 0x7fdc0806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:08.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.823+0000 7fdc2b400640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 0x7fdc0806a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c001e40 tx=0x7fdc1c001db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:08.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:08.823+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fdc140ef420 con 0x7fdc2c155fb0 2024-04-17T14:40:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.079+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdc14015fd0 con 0x7fdc2c155fb0 2024-04-17T14:40:09.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.263+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc2c06bdb0 con 0x7fdc2c155fb0 2024-04-17T14:40:09.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc23e00640 1 -- 172.21.15.16:0/2097174860 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16609 (secure 0 0 0) 0x7fdc140f1380 con 0x7fdc2c155fb0 2024-04-17T14:40:09.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:07.313649+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 msgr2=0x7fdc0806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 0x7fdc0806a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c001e40 tx=0x7fdc1c001db0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 msgr2=0x7fdc2c0c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc140979a0 tx=0x7fdc10005840 comp rx=0 tx=0).stop 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 shutdown_connections 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fdc080683d0 0x7fdc0806a890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdc2c14e850 0x7fdc2c0c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc2c155fb0 0x7fdc2c0c4ae0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 --2- 172.21.15.16:0/2097174860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10004810 0x7fdc2c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 >> 172.21.15.16:0/2097174860 conn(0x7fdc2c072a10 msgr2=0x7fdc2c06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:09.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 shutdown_connections 2024-04-17T14:40:09.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.307+0000 7fdc32200640 1 -- 172.21.15.16:0/2097174860 wait complete. 2024-04-17T14:40:09.328 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T14:40:09.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:09.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 Processor -- start 2024-04-17T14:40:09.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 -- start start 2024-04-17T14:40:09.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 0x7f8cbc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cbc0c4200 0x7f8cbc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc15eb80 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc0cf380 con 0x7f8cbc0c4200 2024-04-17T14:40:09.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc15aed0 con 0x7f8cbc0c9690 2024-04-17T14:40:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc1000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8cbc0c9a70 0x7f8cbc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35668/0 (socket says 172.21.15.16:35668) 2024-04-17T14:40:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.471+0000 7f8cc1000640 1 -- 172.21.15.16:0/3860058246 learned_addr learned my addr 172.21.15.16:0/3860058246 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.475+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673441595 0 0) 0x7f8cbc15eb80 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.475+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ca4003530 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1565842005 0 0) 0x7f8ca4003530 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 msgr2=0x7f8cbc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 0x7f8cbc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 >> v2:172.21.15.67:3300/0 conn(0x7f8cbc0c4200 msgr2=0x7f8cbc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 --2- 172.21.15.16:0/3860058246 >> v2:172.21.15.67:3300/0 conn(0x7f8cbc0c4200 0x7f8cbc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc15ee60 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f8ca8001680 con 0x7f8cbc0c9a70 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 >> v1:172.21.15.16:6789/0 conn(0x7f8cbc0c9a70 legacy=0x7f8cbc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 0x7f8ca40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8ca4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ca4004e70 0x7f8ca400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc0cf380 con 0x7f8ca4004120 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15aed0 con 0x7f8ca4004e70 2024-04-17T14:40:09.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.479+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca40055f0 con 0x7f8cbc0c9690 2024-04-17T14:40:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8ca4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:09.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 -- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 msgr2=0x7f8ca40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:09.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc0c9690 0x7f8ca40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 -- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ca4004e70 msgr2=0x7f8ca400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:09.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ca4004e70 0x7f8ca400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.483+0000 7f8cc1000640 1 -- 172.21.15.16:0/3860058246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca4003530 con 0x7f8ca4004120 2024-04-17T14:40:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.487+0000 7f8cc1000640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8ca4004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c160 tx=0x7f8ca801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303bcd508b5a3f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:09.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007c70 con 0x7f8ca4004120 2024-04-17T14:40:09.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8005b00 con 0x7f8ca4004120 2024-04-17T14:40:09.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cbbe00640 1 -- 172.21.15.16:0/3860058246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007070 con 0x7f8ca4004120 2024-04-17T14:40:09.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cc4400640 1 -- 172.21.15.16:0/3860058246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 msgr2=0x7f8ca4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cc4400640 1 --2- 172.21.15.16:0/3860058246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8ca4004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c160 tx=0x7f8ca801f310 comp rx=0 tx=0).stop 2024-04-17T14:40:09.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.491+0000 7f8cc2400640 1 -- 172.21.15.16:0/3860058246 reap_dead start 2024-04-17T14:40:09.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- 172.21.15.16:0/3860058246 shutdown_connections 2024-04-17T14:40:09.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- 172.21.15.16:0/3860058246 >> 172.21.15.16:0/3860058246 conn(0x7f8cbc062850 msgr2=0x7f8cbc06f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:09.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- 172.21.15.16:0/3860058246 shutdown_connections 2024-04-17T14:40:09.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- 172.21.15.16:0/3860058246 wait complete. 2024-04-17T14:40:09.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 Processor -- start 2024-04-17T14:40:09.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- start start 2024-04-17T14:40:09.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc1542f0 0x7f8cbc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cbc0ccf50 0x7f8cbc0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15b400 con 0x7f8ca4004120 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15b120 con 0x7f8cbc0ccf50 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc0c36c0 con 0x7f8cbc1542f0 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.495+0000 7f8cc1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47948/0 (socket says 172.21.15.16:47948) 2024-04-17T14:40:09.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 -- 172.21.15.16:0/2896453550 learned_addr learned my addr 172.21.15.16:0/2896453550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:09.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 -- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc1542f0 msgr2=0x7f8cbc0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc1542f0 0x7f8cbc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 -- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cbc0ccf50 msgr2=0x7f8cbc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:09.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cbc0ccf50 0x7f8cbc0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:09.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.499+0000 7f8cc1a00640 1 -- 172.21.15.16:0/2896453550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc0cd910 con 0x7f8ca4004120 2024-04-17T14:40:09.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.503+0000 7f8cc1a00640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b4d0 tx=0x7f8cb000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0014070 con 0x7f8ca4004120 2024-04-17T14:40:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb0010870 con 0x7f8ca4004120 2024-04-17T14:40:09.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0010c40 con 0x7f8ca4004120 2024-04-17T14:40:09.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc153220 con 0x7f8ca4004120 2024-04-17T14:40:09.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc155bb0 con 0x7f8ca4004120 2024-04-17T14:40:09.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.507+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc076280 con 0x7f8ca4004120 2024-04-17T14:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.527+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8cb0017070 con 0x7f8ca4004120 2024-04-17T14:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.527+0000 7f8cb9600640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 0x7f8c9c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:09.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.527+0000 7f8cc1000640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 0x7f8c9c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:09.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.531+0000 7f8cc1000640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 0x7f8c9c06a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80ae000 tx=0x7f8cbc0c4670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:09.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.531+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f8cb0054b10 con 0x7f8ca4004120 2024-04-17T14:40:09.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.791+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8cbc0cd910 con 0x7f8ca4004120 2024-04-17T14:40:09.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:09.959+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cbc0c3c90 con 0x7f8ca4004120 2024-04-17T14:40:10.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cb9600640 1 -- 172.21.15.16:0/2896453550 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7f8cb0057170 con 0x7f8ca4004120 2024-04-17T14:40:10.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:10.000 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 msgr2=0x7f8c9c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 0x7f8c9c06a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80ae000 tx=0x7f8cbc0c4670 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 msgr2=0x7f8cbc155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b4d0 tx=0x7f8cb000b990 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 shutdown_connections 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8c9c0683d0 0x7f8c9c06a890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cbc0ccf50 0x7f8cbc0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cbc1542f0 0x7f8cbc0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 --2- 172.21.15.16:0/2896453550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ca4004120 0x7f8cbc155160 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 >> 172.21.15.16:0/2896453550 conn(0x7f8cbc062850 msgr2=0x7f8cbc0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 shutdown_connections 2024-04-17T14:40:10.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.003+0000 7f8cc4400640 1 -- 172.21.15.16:0/2896453550 wait complete. 2024-04-17T14:40:10.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T14:40:10.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T14:40:10.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T14:40:10.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T14:40:10.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T14:40:10.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T14:40:10.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T14:40:10.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T14:40:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 Processor -- start 2024-04-17T14:40:10.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 -- start start 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00dd2c0 0x7f38b00e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38b00e71f0 0x7f38b00e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 0x7f38b0046710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f38b004c690 con 0x7f38b00462a0 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f38b00454e0 con 0x7f38b00e71f0 2024-04-17T14:40:10.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f38b7e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f38b00457c0 con 0x7f38b00dd2c0 2024-04-17T14:40:10.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.275+0000 7f04bec00640 1 Processor -- start 2024-04-17T14:40:10.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 -- start start 2024-04-17T14:40:10.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f38b6000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38b00e71f0 0x7f38b00e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f38b7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 0x7f38b0046710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f38b7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 0x7f38b0046710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47952/0 (socket says 172.21.15.16:47952) 2024-04-17T14:40:10.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f38b7400640 1 -- 172.21.15.16:0/843389161 learned_addr learned my addr 172.21.15.16:0/843389161 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f38b6a00640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00dd2c0 0x7f38b00e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04b806bc90 0x7f04b80718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04b80c96a0 0x7f04b8161560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b8157660 con 0x7f04b806d5e0 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f04b8157bc0 con 0x7f04b806bc90 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f04bec00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f04b8157900 con 0x7f04b80c96a0 2024-04-17T14:40:10.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f2df6a00640 1 Processor -- start 2024-04-17T14:40:10.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 Processor -- start 2024-04-17T14:40:10.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 Processor -- start 2024-04-17T14:40:10.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 -- start start 2024-04-17T14:40:10.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 -- start start 2024-04-17T14:40:10.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.279+0000 7f2df6a00640 1 -- start start 2024-04-17T14:40:10.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f04bce00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f04b806d5e0 0x7f04b806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35670/0 (socket says 172.21.15.16:35670) 2024-04-17T14:40:10.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f04bce00640 1 -- 172.21.15.16:0/3997292040 learned_addr learned my addr 172.21.15.16:0/3997292040 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f2df6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2df015fe80 0x7f2df00c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f2df6a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f2df6a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df00c5720 con 0x7f2df00ca7c0 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f2df6a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2df00c54f0 con 0x7f2df015fe80 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f2df6a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f2df0160260 con 0x7f2df00c7a30 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f884006bc90 0x7f88400718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88400c96a0 0x7f8840161560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8840157660 con 0x7f884006d5e0 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8840157bc0 con 0x7f884006bc90 2024-04-17T14:40:10.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f883f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8840157900 con 0x7f88400c96a0 2024-04-17T14:40:10.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7fb5d1200640 1 Processor -- start 2024-04-17T14:40:10.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9250150fc0 0x7f925006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7fb5d1200640 1 -- start start 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92500c8760 0x7f925006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92501513a0 con 0x7f92500700a0 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f92500c8cf0 con 0x7f92500c8760 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.283+0000 7f9255600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9250157ad0 con 0x7f9250150fc0 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7f38b6000640 1 -- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00dd2c0 msgr2=0x7f38b00e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7f38b6000640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00dd2c0 0x7f38b00e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7f38b6000640 1 -- 172.21.15.16:0/843389161 >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 msgr2=0x7f38b0046710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7f38b6000640 1 --2- 172.21.15.16:0/843389161 >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 0x7f38b0046710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7f38b6000640 1 -- 172.21.15.16:0/843389161 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b0045aa0 con 0x7f38b00e71f0 2024-04-17T14:40:10.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d1200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5cc155020 0x7fb5cc15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d1200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc0cbf10 con 0x7fb5cc0cb010 2024-04-17T14:40:10.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d1200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc15b090 con 0x7fb5cc0cc3c0 2024-04-17T14:40:10.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d1200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc15b370 con 0x7fb5cc155020 2024-04-17T14:40:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d6200640 1 Processor -- start 2024-04-17T14:40:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.287+0000 7fb5d6200640 1 -- start start 2024-04-17T14:40:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 Processor -- start 2024-04-17T14:40:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fb5d6200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5d00cae50 0x7fb5d00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fb5d6200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d0162980 con 0x7fb5d01624f0 2024-04-17T14:40:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 -- start start 2024-04-17T14:40:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fb5d6200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d0162c60 con 0x7fb5d00c49c0 2024-04-17T14:40:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fb5d6200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d00c3e20 con 0x7fb5d00cae50 2024-04-17T14:40:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac700c8d80 0x7fac7015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac700c9ef0 con 0x7fac7015fde0 2024-04-17T14:40:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fac700c3b70 con 0x7fac700c8d80 2024-04-17T14:40:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac75000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fac7015f0c0 con 0x7fac700b1fc0 2024-04-17T14:40:10.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f04bd800640 1 --2- 172.21.15.16:0/3997292040 >> v2:172.21.15.16:3300/0 conn(0x7f04b806bc90 0x7f04b80718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f883de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f884006bc90 0x7f88400718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7fac6f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f883de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f884006bc90 0x7f88400718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47968/0 (socket says 172.21.15.16:47968) 2024-04-17T14:40:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f883de00640 1 -- 172.21.15.16:0/2465700642 learned_addr learned my addr 172.21.15.16:0/2465700642 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f04be200640 1 --2- 172.21.15.16:0/3997292040 >> v2:172.21.15.67:3300/0 conn(0x7f04b80c96a0 0x7f04b8161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.291+0000 7f2df4a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f2df4a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44256/0 (socket says 172.21.15.16:44256) 2024-04-17T14:40:10.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f2df4a00640 1 -- 172.21.15.16:0/2138384978 learned_addr learned my addr 172.21.15.16:0/2138384978 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7fac6f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44268/0 (socket says 172.21.15.16:44268) 2024-04-17T14:40:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7fac6f400640 1 -- 172.21.15.16:0/3347121604 learned_addr learned my addr 172.21.15.16:0/3347121604 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f04bd800640 1 -- 172.21.15.16:0/3997292040 >> v2:172.21.15.67:3300/0 conn(0x7f04b80c96a0 msgr2=0x7f04b8161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f04bd800640 1 --2- 172.21.15.16:0/3997292040 >> v2:172.21.15.67:3300/0 conn(0x7f04b80c96a0 0x7f04b8161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f04bd800640 1 -- 172.21.15.16:0/3997292040 >> v1:172.21.15.16:6789/0 conn(0x7f04b806d5e0 legacy=0x7f04b806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.295+0000 7f04bd800640 1 -- 172.21.15.16:0/3997292040 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80c6bb0 con 0x7f04b806bc90 2024-04-17T14:40:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f883de00640 1 -- 172.21.15.16:0/2465700642 >> v2:172.21.15.67:3300/0 conn(0x7f88400c96a0 msgr2=0x7f8840161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f883de00640 1 --2- 172.21.15.16:0/2465700642 >> v2:172.21.15.67:3300/0 conn(0x7f88400c96a0 0x7f8840161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f883de00640 1 -- 172.21.15.16:0/2465700642 >> v1:172.21.15.67:6789/0 conn(0x7f884006d5e0 legacy=0x7f884006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f883de00640 1 -- 172.21.15.16:0/2465700642 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400c6bb0 con 0x7f884006bc90 2024-04-17T14:40:10.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f924e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92500c8760 0x7f925006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f924e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92500c8760 0x7f925006f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47982/0 (socket says 172.21.15.16:47982) 2024-04-17T14:40:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.299+0000 7f924e000640 1 -- 172.21.15.16:0/2643972728 learned_addr learned my addr 172.21.15.16:0/2643972728 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f883de00640 1 --2- 172.21.15.16:0/2465700642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88400718b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8840071440 tx=0x7f883001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e75270060d33a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7fac6f400640 1 -- 172.21.15.16:0/3347121604 >> v2:172.21.15.67:3300/0 conn(0x7fac700c8d80 msgr2=0x7fac7015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7fac6f400640 1 --2- 172.21.15.16:0/3347121604 >> v2:172.21.15.67:3300/0 conn(0x7fac700c8d80 0x7fac7015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7fac6f400640 1 -- 172.21.15.16:0/3347121604 >> v1:172.21.15.16:6789/0 conn(0x7fac7015fde0 legacy=0x7fac7006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7fac6f400640 1 -- 172.21.15.16:0/3347121604 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac701631e0 con 0x7fac700b1fc0 2024-04-17T14:40:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f38b6000640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b00e6c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38b00079c0 tx=0x7f38a401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74b2d1553d08674 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f924e000640 1 -- 172.21.15.16:0/2643972728 >> v2:172.21.15.67:3300/0 conn(0x7f9250150fc0 msgr2=0x7f925006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f924e000640 1 --2- 172.21.15.16:0/2643972728 >> v2:172.21.15.67:3300/0 conn(0x7f9250150fc0 0x7f925006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f924e000640 1 -- 172.21.15.16:0/2643972728 >> v1:172.21.15.67:6789/0 conn(0x7f92500700a0 legacy=0x7f92500c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.303+0000 7f924e000640 1 -- 172.21.15.16:0/2643972728 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92500c36a0 con 0x7f92500c8760 2024-04-17T14:40:10.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7fb5cfe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb5d01624f0 0x7fb5d00c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35682/0 (socket says 172.21.15.16:35682) 2024-04-17T14:40:10.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1283020315 learned_addr learned my addr 172.21.15.16:0/1283020315 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7f2df4a00640 1 -- 172.21.15.16:0/2138384978 >> v2:172.21.15.67:3300/0 conn(0x7f2df015fe80 msgr2=0x7f2df00c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7f2df4a00640 1 --2- 172.21.15.16:0/2138384978 >> v2:172.21.15.67:3300/0 conn(0x7f2df015fe80 0x7f2df00c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7f2df4a00640 1 -- 172.21.15.16:0/2138384978 >> v1:172.21.15.67:6789/0 conn(0x7f2df00ca7c0 legacy=0x7f2df00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.307+0000 7f2df4a00640 1 -- 172.21.15.16:0/2138384978 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df00c59e0 con 0x7f2df00c7a30 2024-04-17T14:40:10.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.311+0000 7fb5c3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb5cc0cb010 0x7fb5cc06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35674/0 (socket says 172.21.15.16:35674) 2024-04-17T14:40:10.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.311+0000 7fb5c3e00640 1 -- 172.21.15.16:0/2788566879 learned_addr learned my addr 172.21.15.16:0/2788566879 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.311+0000 7f04bd800640 1 --2- 172.21.15.16:0/3997292040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806bc90 0x7f04b80718b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04b8156be0 tx=0x7f04ac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd79342bcaefa4d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883ca00640 1 -- 172.21.15.16:0/2465700642 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88300b1070 con 0x7f884006bc90 2024-04-17T14:40:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883ca00640 1 -- 172.21.15.16:0/2465700642 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88300ac410 con 0x7f884006bc90 2024-04-17T14:40:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883ca00640 1 -- 172.21.15.16:0/2465700642 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88300ac7e0 con 0x7f884006bc90 2024-04-17T14:40:10.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7fb5d4e00640 1 --2- 172.21.15.16:0/1283020315 >> v2:172.21.15.67:3300/0 conn(0x7fb5d00cae50 0x7fb5d00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7fac6f400640 1 --2- 172.21.15.16:0/3347121604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac60009870 tx=0x7fac6001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a90a735b3615483 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- 172.21.15.16:0/2465700642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 msgr2=0x7f88400718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 --2- 172.21.15.16:0/2465700642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88400718b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8840071440 tx=0x7f883001c4c0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- 172.21.15.16:0/2465700642 shutdown_connections 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 --2- 172.21.15.16:0/2465700642 >> v2:172.21.15.67:3300/0 conn(0x7f88400c96a0 0x7f8840161560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 --2- 172.21.15.16:0/2465700642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88400718b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- 172.21.15.16:0/2465700642 >> 172.21.15.16:0/2465700642 conn(0x7f88400c8b80 msgr2=0x7f88400c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- 172.21.15.16:0/2465700642 shutdown_connections 2024-04-17T14:40:10.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- 172.21.15.16:0/2465700642 wait complete. 2024-04-17T14:40:10.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 Processor -- start 2024-04-17T14:40:10.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.315+0000 7f883f200640 1 -- start start 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88401f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f884006d5e0 0x7f88400c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88400c96a0 0x7f8840164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88400c7970 con 0x7f884006bc90 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f884006c780 con 0x7f88400c96a0 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f883f200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f88400c4cb0 con 0x7f884006d5e0 2024-04-17T14:40:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7f924e000640 1 --2- 172.21.15.16:0/2643972728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f925006f450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92500cd4a0 tx=0x7f923801fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57798cf07c7d659 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14024301 0 0) 0x7fb5d0162980 con 0x7fb5d01624f0 2024-04-17T14:40:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.319+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b8003530 con 0x7fb5d01624f0 2024-04-17T14:40:10.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.323+0000 7fb5c9e00640 1 --2- 172.21.15.16:0/2788566879 >> v2:172.21.15.67:3300/0 conn(0x7fb5cc155020 0x7fb5cc15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.323+0000 7fac6e000640 1 -- 172.21.15.16:0/3347121604 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab5f0 con 0x7fac700b1fc0 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.323+0000 7fac6e000640 1 -- 172.21.15.16:0/3347121604 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600b0070 con 0x7fac700b1fc0 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.323+0000 7fac6e000640 1 -- 172.21.15.16:0/3347121604 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab9b0 con 0x7fac700b1fc0 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- 172.21.15.16:0/3347121604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 msgr2=0x7fac700b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- 172.21.15.16:0/3347121604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac60009870 tx=0x7fac6001c520 comp rx=0 tx=0).stop 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681422154 0 0) 0x7fb5cc0cbf10 con 0x7fb5cc0cb010 2024-04-17T14:40:10.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b0003530 con 0x7fb5cc0cb010 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- 172.21.15.16:0/3347121604 shutdown_connections 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- 172.21.15.16:0/3347121604 >> v2:172.21.15.67:3300/0 conn(0x7fac700c8d80 0x7fac7015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- 172.21.15.16:0/3347121604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac700b23a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- 172.21.15.16:0/3347121604 >> 172.21.15.16:0/3347121604 conn(0x7fac70062ab0 msgr2=0x7fac70071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- 172.21.15.16:0/3347121604 shutdown_connections 2024-04-17T14:40:10.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- 172.21.15.16:0/3347121604 wait complete. 2024-04-17T14:40:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7f2df4a00640 1 --2- 172.21.15.16:0/2138384978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cadbafb88e6f9567 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7f883de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88401f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 Processor -- start 2024-04-17T14:40:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- start start 2024-04-17T14:40:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac70150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac700c8d80 0x7fac701fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac7015fde0 0x7fac701f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac7015cc90 con 0x7fac700c8d80 2024-04-17T14:40:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac7016c980 con 0x7fac7015fde0 2024-04-17T14:40:10.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.327+0000 7fac75000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fac7014eec0 con 0x7fac700b1fc0 2024-04-17T14:40:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04b7e00640 1 -- 172.21.15.16:0/3997292040 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b0070 con 0x7f04b806bc90 2024-04-17T14:40:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04b7e00640 1 -- 172.21.15.16:0/3997292040 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac0ab600 con 0x7f04b806bc90 2024-04-17T14:40:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04b7e00640 1 -- 172.21.15.16:0/3997292040 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0ab9d0 con 0x7f04b806bc90 2024-04-17T14:40:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- 172.21.15.16:0/3997292040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806bc90 msgr2=0x7f04b80718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 --2- 172.21.15.16:0/3997292040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806bc90 0x7f04b80718b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04b8156be0 tx=0x7f04ac01c480 comp rx=0 tx=0).stop 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f883de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88401f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47990/0 (socket says 172.21.15.16:47990) 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f883de00640 1 -- 172.21.15.16:0/3175821349 learned_addr learned my addr 172.21.15.16:0/3175821349 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- 172.21.15.16:0/3997292040 shutdown_connections 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 --2- 172.21.15.16:0/3997292040 >> v2:172.21.15.67:3300/0 conn(0x7f04b80c96a0 0x7f04b8161560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 --2- 172.21.15.16:0/3997292040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806bc90 0x7f04b80718b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- 172.21.15.16:0/3997292040 >> 172.21.15.16:0/3997292040 conn(0x7f04b80c8b80 msgr2=0x7f04b80c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- 172.21.15.16:0/3997292040 shutdown_connections 2024-04-17T14:40:10.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- 172.21.15.16:0/3997292040 wait complete. 2024-04-17T14:40:10.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 563552605 0 0) 0x7fb5b8003530 con 0x7fb5d01624f0 2024-04-17T14:40:10.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 >> v2:172.21.15.67:3300/0 conn(0x7fb5d00cae50 msgr2=0x7fb5d00cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 --2- 172.21.15.16:0/1283020315 >> v2:172.21.15.67:3300/0 conn(0x7fb5d00cae50 0x7fb5d00cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 >> v1:172.21.15.67:6789/0 conn(0x7fb5d00c49c0 legacy=0x7fb5d0169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d0162f40 con 0x7fb5d01624f0 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fb5bc001680 con 0x7fb5d01624f0 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 >> v1:172.21.15.16:6789/0 conn(0x7fb5d01624f0 legacy=0x7fb5d00c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8003a10 0x7fb5b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00c3e20 con 0x7fb5b8004810 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800c080 con 0x7fb5b80051d0 2024-04-17T14:40:10.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b800c280 con 0x7fb5b8003a10 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 Processor -- start 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.331+0000 7f04bec00640 1 -- start start 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 0x7f04b81f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806d5e0 0x7f04b8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b80c96a0 0x7f04b8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80c7970 con 0x7f04b806d5e0 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04b806c780 con 0x7f04b80c96a0 2024-04-17T14:40:10.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f04bec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f04b81f3ee0 con 0x7f04b806bc90 2024-04-17T14:40:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.335+0000 7f883d400640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f884006d5e0 0x7f88400c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f883de00640 1 -- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f884006d5e0 msgr2=0x7f88400c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f883de00640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f884006d5e0 0x7f88400c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f883de00640 1 -- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88400c96a0 msgr2=0x7f8840164d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f883de00640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88400c96a0 0x7f8840164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f883de00640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400c5f60 con 0x7f884006bc90 2024-04-17T14:40:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f924d600640 1 -- 172.21.15.16:0/2643972728 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238008be0 con 0x7f92500c8760 2024-04-17T14:40:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f924d600640 1 -- 172.21.15.16:0/2643972728 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9238008d80 con 0x7f92500c8760 2024-04-17T14:40:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7f924d600640 1 -- 172.21.15.16:0/2643972728 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380a9b10 con 0x7f92500c8760 2024-04-17T14:40:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.339+0000 7fac6f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac70150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- 172.21.15.16:0/2643972728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 msgr2=0x7f925006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- 172.21.15.16:0/2643972728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f925006f450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92500cd4a0 tx=0x7f923801fce0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- 172.21.15.16:0/2643972728 shutdown_connections 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- 172.21.15.16:0/2643972728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f925006f450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- 172.21.15.16:0/2643972728 >> v2:172.21.15.67:3300/0 conn(0x7f9250150fc0 0x7f925006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- 172.21.15.16:0/2643972728 >> 172.21.15.16:0/2643972728 conn(0x7f925006ba30 msgr2=0x7f925006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7fac6f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac70150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44290/0 (socket says 172.21.15.16:44290) 2024-04-17T14:40:10.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7fac6f400640 1 -- 172.21.15.16:0/3709003108 learned_addr learned my addr 172.21.15.16:0/3709003108 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- 172.21.15.16:0/2643972728 shutdown_connections 2024-04-17T14:40:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- 172.21.15.16:0/2643972728 wait complete. 2024-04-17T14:40:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f883de00640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88401f5050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88300af040 tx=0x7f8830019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7fb5d4e00640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8003a10 0x7fb5b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 Processor -- start 2024-04-17T14:40:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- start start 2024-04-17T14:40:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92500700a0 0x7f9250148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f92501f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9250150fc0 0x7f92501f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92500c7150 con 0x7f92500c8760 2024-04-17T14:40:10.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92500c6e70 con 0x7f9250150fc0 2024-04-17T14:40:10.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f9255600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f92500c7430 con 0x7f92500700a0 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f2deea00640 1 -- 172.21.15.16:0/2138384978 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00b5070 con 0x7f2df00c7a30 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f2deea00640 1 -- 172.21.15.16:0/2138384978 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de00a89d0 con 0x7f2df00c7a30 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.343+0000 7f2deea00640 1 -- 172.21.15.16:0/2138384978 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00a8da0 con 0x7f2df00c7a30 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- 172.21.15.16:0/2138384978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 msgr2=0x7f2df0169b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- 172.21.15.16:0/2138384978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- 172.21.15.16:0/2138384978 shutdown_connections 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- 172.21.15.16:0/2138384978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df0169b40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- 172.21.15.16:0/2138384978 >> v2:172.21.15.67:3300/0 conn(0x7f2df015fe80 0x7f2df00c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- 172.21.15.16:0/2138384978 >> 172.21.15.16:0/2138384978 conn(0x7f2df0062450 msgr2=0x7f2df0062860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- 172.21.15.16:0/2138384978 shutdown_connections 2024-04-17T14:40:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- 172.21.15.16:0/2138384978 wait complete. 2024-04-17T14:40:10.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 Processor -- start 2024-04-17T14:40:10.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- start start 2024-04-17T14:40:10.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f04bd800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 0x7f04b81f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2df00ca7c0 0x7f2df0160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 0x7f2df00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cc510 con 0x7f2df015fe80 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cc230 con 0x7f2df00ca7c0 2024-04-17T14:40:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.347+0000 7f2df6a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00ca2a0 con 0x7f2df00c7a30 2024-04-17T14:40:10.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6ea00640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac700c8d80 0x7fac701fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6f400640 1 -- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac7015fde0 msgr2=0x7fac701f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6f400640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac7015fde0 0x7fac701f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6f400640 1 -- 172.21.15.16:0/3709003108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac700c8d80 msgr2=0x7fac701fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6f400640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac700c8d80 0x7fac701fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.351+0000 7fac6f400640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac701fbf00 con 0x7fac700b1fc0 2024-04-17T14:40:10.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8003a10 msgr2=0x7fb5b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8003a10 0x7fb5b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 msgr2=0x7fb5b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b80051d0 0x7fb5b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1283020315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b8003530 con 0x7fb5b8004810 2024-04-17T14:40:10.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.355+0000 7fb5d5800640 1 -- 172.21.15.16:0/1283020315 reap_dead start 2024-04-17T14:40:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b5600640 1 -- 172.21.15.16:0/843389161 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40b5070 con 0x7f38b00e71f0 2024-04-17T14:40:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b5600640 1 -- 172.21.15.16:0/843389161 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a40a8830 con 0x7f38b00e71f0 2024-04-17T14:40:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 -- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 msgr2=0x7f38b00e6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b5600640 1 -- 172.21.15.16:0/843389161 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40b5070 con 0x7f38b00e71f0 2024-04-17T14:40:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b00e6c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38b00079c0 tx=0x7f38a401ec70 comp rx=0 tx=0).stop 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 -- 172.21.15.16:0/843389161 shutdown_connections 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 --2- 172.21.15.16:0/843389161 >> v2:172.21.15.16:3300/0 conn(0x7f38b00462a0 0x7f38b0046710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b00e6c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 --2- 172.21.15.16:0/843389161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00dd2c0 0x7f38b00e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 -- 172.21.15.16:0/843389161 >> 172.21.15.16:0/843389161 conn(0x7f38b0050190 msgr2=0x7f38b00505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 -- 172.21.15.16:0/843389161 shutdown_connections 2024-04-17T14:40:10.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.359+0000 7f38b7e00640 1 -- 172.21.15.16:0/843389161 wait complete. 2024-04-17T14:40:10.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 Processor -- start 2024-04-17T14:40:10.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 -- start start 2024-04-17T14:40:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00462a0 0x7f38b00e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38b00dd2c0 0x7f38b0047610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b017bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38b004ba70 con 0x7f38b00dd2c0 2024-04-17T14:40:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38b004c970 con 0x7f38b00e71f0 2024-04-17T14:40:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f38b7e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f38b004bbf0 con 0x7f38b00462a0 2024-04-17T14:40:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 0x7fb5b8004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c110 tx=0x7fb5bc01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442c699feee47321 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f04bce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806d5e0 0x7f04b8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88300bc070 con 0x7f884006bc90 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88300acdc0 con 0x7f884006bc90 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88300b1040 con 0x7f884006bc90 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88400c6240 con 0x7f884006bc90 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88400c4940 con 0x7f884006bc90 2024-04-17T14:40:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fac6f400640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac70150780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac6001cdc0 tx=0x7fac6001ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88400c5d00 con 0x7f884006bc90 2024-04-17T14:40:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685870690 0 0) 0x7fb5b0003530 con 0x7fb5cc0cb010 2024-04-17T14:40:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 >> v2:172.21.15.67:3300/0 conn(0x7fb5cc155020 msgr2=0x7fb5cc15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 --2- 172.21.15.16:0/2788566879 >> v2:172.21.15.67:3300/0 conn(0x7fb5cc155020 0x7fb5cc15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 >> v1:172.21.15.67:6789/0 conn(0x7fb5cc0cc3c0 legacy=0x7fb5cc0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc15b650 con 0x7fb5cc0cb010 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fb5b4001680 con 0x7fb5cc0cb010 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 >> v1:172.21.15.16:6789/0 conn(0x7fb5cc0cb010 legacy=0x7fb5cc06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f04bd800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 0x7f04b81f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44322/0 (socket says 172.21.15.16:44322) 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7f04bd800640 1 -- 172.21.15.16:0/1604168300 learned_addr learned my addr 172.21.15.16:0/1604168300 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0003a10 0x7fb5b0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b0004810 0x7fb5b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc15b370 con 0x7fb5b00051d0 2024-04-17T14:40:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b000c0b0 con 0x7fb5b0003a10 2024-04-17T14:40:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.363+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b000c2b0 con 0x7fb5b0004810 2024-04-17T14:40:10.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.367+0000 7f924e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f92501f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.367+0000 7f2df4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 0x7f2df00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.371+0000 7f924e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f92501f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48024/0 (socket says 172.21.15.16:48024) 2024-04-17T14:40:10.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.371+0000 7f924e000640 1 -- 172.21.15.16:0/1462954168 learned_addr learned my addr 172.21.15.16:0/1462954168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.371+0000 7f2df4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 0x7f2df00cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48028/0 (socket says 172.21.15.16:48028) 2024-04-17T14:40:10.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.371+0000 7f2df4a00640 1 -- 172.21.15.16:0/4176059423 learned_addr learned my addr 172.21.15.16:0/4176059423 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.375+0000 7f04bd800640 1 -- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b80c96a0 msgr2=0x7f04b8149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.375+0000 7f04bd800640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b80c96a0 0x7f04b8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.375+0000 7f04bd800640 1 -- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806d5e0 msgr2=0x7f04b8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.375+0000 7f04bd800640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b806d5e0 0x7f04b8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.375+0000 7f04bd800640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80c9000 con 0x7f04b806bc90 2024-04-17T14:40:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600be5f0 con 0x7fac700b1fc0 2024-04-17T14:40:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600be7b0 con 0x7fac700b1fc0 2024-04-17T14:40:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600beba0 con 0x7fac700b1fc0 2024-04-17T14:40:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac70162310 con 0x7fac700b1fc0 2024-04-17T14:40:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac700c59c0 con 0x7fac700b1fc0 2024-04-17T14:40:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac700761a0 con 0x7fac700b1fc0 2024-04-17T14:40:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.379+0000 7fb5ca800640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.383+0000 7f924e000640 1 -- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92500700a0 msgr2=0x7f9250148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.383+0000 7f924e000640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92500700a0 0x7f9250148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.383+0000 7f924e000640 1 -- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9250150fc0 msgr2=0x7f92501f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.383+0000 7f924e000640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9250150fc0 0x7f92501f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.383+0000 7f924e000640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9250156d00 con 0x7f92500c8760 2024-04-17T14:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f04bd800640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 0x7f04b81f6c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04ac019090 tx=0x7f04ac019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f2df4a00640 1 -- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 msgr2=0x7f2df015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f2df4a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2df00c7a30 0x7f2df015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f2df4a00640 1 -- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2df00ca7c0 msgr2=0x7f2df0160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f2df4a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2df00ca7c0 0x7f2df0160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.387+0000 7f2df4a00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df01ec700 con 0x7f2df015fe80 2024-04-17T14:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.391+0000 7f924e000640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f92501f1760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92380b3040 tx=0x7f923801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.391+0000 7f2df4a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 0x7f2df00cfaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.395+0000 7fb5ca800640 1 -- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b0004810 msgr2=0x7fb5b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.395+0000 7fb5ca800640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b0004810 0x7fb5b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.395+0000 7fb5ca800640 1 -- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0003a10 msgr2=0x7fb5b0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.395+0000 7fb5ca800640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5b0003a10 0x7fb5b0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.395+0000 7fb5ca800640 1 -- 172.21.15.16:0/2788566879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0003530 con 0x7fb5b00051d0 2024-04-17T14:40:10.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.399+0000 7fb5ca800640 1 -- 172.21.15.16:0/2788566879 reap_dead start 2024-04-17T14:40:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7f38b6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38b00dd2c0 0x7f38b0047610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc007c50 con 0x7fb5b8004810 2024-04-17T14:40:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0a9020 con 0x7fb5b8004810 2024-04-17T14:40:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5cf400640 1 -- 172.21.15.16:0/1283020315 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc005b00 con 0x7fb5b8004810 2024-04-17T14:40:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 -- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 msgr2=0x7fb5b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 0x7fb5b8004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c110 tx=0x7fb5bc01cba0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 -- 172.21.15.16:0/1283020315 shutdown_connections 2024-04-17T14:40:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 --2- 172.21.15.16:0/1283020315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b8004810 0x7fb5b8004c90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 -- 172.21.15.16:0/1283020315 >> 172.21.15.16:0/1283020315 conn(0x7fb5d0071440 msgr2=0x7fb5d0071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 -- 172.21.15.16:0/1283020315 shutdown_connections 2024-04-17T14:40:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5d6200640 1 -- 172.21.15.16:0/1283020315 wait complete. 2024-04-17T14:40:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.407+0000 7fb5ca800640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5b000b9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4001e70 tx=0x7fb5c401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1debede560ef952f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 Processor -- start 2024-04-17T14:40:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 -- start start 2024-04-17T14:40:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8004810 0x7fb5d00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 0x7fb5d0157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5d01612d0 0x7fb5d0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00c9050 con 0x7fb5d01612d0 2024-04-17T14:40:10.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d015fe70 con 0x7fb5d0156cf0 2024-04-17T14:40:10.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.411+0000 7fb5d6200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d00c9580 con 0x7fb5b8004810 2024-04-17T14:40:10.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.415+0000 7f38b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b017bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.415+0000 7fb5cfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 0x7fb5d0157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.419+0000 7f38b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b017bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48698/0 (socket says 172.21.15.16:48698) 2024-04-17T14:40:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.419+0000 7f38b7400640 1 -- 172.21.15.16:0/1954928598 learned_addr learned my addr 172.21.15.16:0/1954928598 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.419+0000 7fb5cfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 0x7fb5d0157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48716/0 (socket says 172.21.15.16:48716) 2024-04-17T14:40:10.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.419+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1450579755 learned_addr learned my addr 172.21.15.16:0/1450579755 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.423+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88300bf070 con 0x7f884006bc90 2024-04-17T14:40:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.423+0000 7f8836000640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f88200683d0 0x7f882006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.423+0000 7f883d400640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f88200683d0 0x7f882006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.423+0000 7f883d400640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f88200683d0 0x7f882006a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f884013a800 tx=0x7f882c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f88300ee250 con 0x7f884006bc90 2024-04-17T14:40:10.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f8836000640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7f88200705d0 0x7f88200729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88300aee90 con 0x7f88200705d0 2024-04-17T14:40:10.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88300ec450 con 0x7f884006bc90 2024-04-17T14:40:10.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f883e800640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7f88200705d0 0x7f88200729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.427+0000 7f883e800640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7f88200705d0 0x7f88200729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238007d20 con 0x7f92500c8760 2024-04-17T14:40:10.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923800a0d0 con 0x7f92500c8760 2024-04-17T14:40:10.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923800a4c0 con 0x7f92500c8760 2024-04-17T14:40:10.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9250156180 con 0x7f92500c8760 2024-04-17T14:40:10.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9250156740 con 0x7f92500c8760 2024-04-17T14:40:10.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9250076280 con 0x7f92500c8760 2024-04-17T14:40:10.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== osd.5 v2:172.21.15.67:6810/1857257902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88300aee90 con 0x7f88200705d0 2024-04-17T14:40:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7fb5d5800640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5d01612d0 0x7fb5d0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f38b7400640 1 -- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00462a0 msgr2=0x7f38b00e3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f38b7400640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38b00462a0 0x7f38b00e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f38b7400640 1 -- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38b00dd2c0 msgr2=0x7f38b0047610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.431+0000 7f38b7400640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38b00dd2c0 0x7f38b0047610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.435+0000 7f38b7400640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b0047b50 con 0x7f38b00e71f0 2024-04-17T14:40:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.443+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8004810 msgr2=0x7fb5d00cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.443+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5b8004810 0x7fb5d00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.443+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1450579755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5d01612d0 msgr2=0x7fb5d0152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.443+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5d01612d0 0x7fb5d0152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.443+0000 7fb5cfe00640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d00ce0f0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00b5040 con 0x7f2df015fe80 2024-04-17T14:40:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de00be070 con 0x7f2df015fe80 2024-04-17T14:40:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00b0a30 con 0x7f2df015fe80 2024-04-17T14:40:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01ec180 con 0x7f2df015fe80 2024-04-17T14:40:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01ec420 con 0x7f2df015fe80 2024-04-17T14:40:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.447+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2df0076280 con 0x7f2df015fe80 2024-04-17T14:40:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4001a90 con 0x7fb5b00051d0 2024-04-17T14:40:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c4003bc0 con 0x7fb5b00051d0 2024-04-17T14:40:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5c9400640 1 -- 172.21.15.16:0/2788566879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4005020 con 0x7fb5b00051d0 2024-04-17T14:40:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 --> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88400c44a0 con 0x7f88200705d0 2024-04-17T14:40:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac600b43f0 con 0x7fac700b1fc0 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 msgr2=0x7fb5b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5b000b9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4001e70 tx=0x7fb5c401c780 comp rx=0 tx=0).stop 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- 172.21.15.16:0/2788566879 shutdown_connections 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 --2- 172.21.15.16:0/2788566879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5b000b9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- 172.21.15.16:0/2788566879 >> 172.21.15.16:0/2788566879 conn(0x7fb5cc062620 msgr2=0x7fb5cc0d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- 172.21.15.16:0/2788566879 shutdown_connections 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- 172.21.15.16:0/2788566879 wait complete. 2024-04-17T14:40:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f8836000640 1 -- 172.21.15.16:0/3175821349 <== osd.5 v2:172.21.15.67:6810/1857257902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f883800a720 con 0x7f88200705d0 2024-04-17T14:40:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fac67400640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac4c0683d0 0x7fac4c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7f88200705d0 msgr2=0x7f88200729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7f88200705d0 0x7f88200729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f88200683d0 msgr2=0x7f882006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f88200683d0 0x7f882006a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f884013a800 tx=0x7f882c009040 comp rx=0 tx=0).stop 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 msgr2=0x7f88401f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 --2- 172.21.15.16:0/3175821349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f884006bc90 0x7f88401f5050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88300af040 tx=0x7f8830019260 comp rx=0 tx=0).stop 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883e800640 1 -- 172.21.15.16:0/3175821349 reap_dead start 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 shutdown_connections 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 >> 172.21.15.16:0/3175821349 conn(0x7f88400c8b80 msgr2=0x7f88400cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 shutdown_connections 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7f883f200640 1 -- 172.21.15.16:0/3175821349 wait complete. 2024-04-17T14:40:10.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fac6ea00640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac4c0683d0 0x7fac4c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 Processor -- start 2024-04-17T14:40:10.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fac6ea00640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac4c0683d0 0x7fac4c06a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac700c9da0 tx=0x7fac58006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.451+0000 7fb5d1200640 1 -- start start 2024-04-17T14:40:10.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5cc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5cc1f32c0 0x7fb5cc153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 0x7fb5cc15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc15bc10 con 0x7fb5b00051d0 2024-04-17T14:40:10.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0d1500 con 0x7fb5cc153740 2024-04-17T14:40:10.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5d1200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc155400 con 0x7fb5cc1f32c0 2024-04-17T14:40:10.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7f38b7400640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b017bda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e8b0 tx=0x7f38a800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.455+0000 7fb5cfe00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 0x7fb5d0157440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0ab040 tx=0x7fb5b8005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fac600ef330 con 0x7fac700b1fc0 2024-04-17T14:40:10.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac67400640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7fac4c0705d0 0x7fac4c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac60001d40 con 0x7fac4c0705d0 2024-04-17T14:40:10.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac6fe00640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7fac4c0705d0 0x7fac4c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac600ed530 con 0x7fac700b1fc0 2024-04-17T14:40:10.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.463+0000 7fac6fe00640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7fac4c0705d0 0x7fac4c0729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.467+0000 7fb5ca800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 0x7fb5cc15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.467+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== osd.6 v2:172.21.15.67:6826/3773130679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac60001d40 con 0x7fac4c0705d0 2024-04-17T14:40:10.470 INFO:teuthology.orchestra.run.smithi016.stdout:60129542158 2024-04-17T14:40:10.471 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T14:40:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8017070 con 0x7f38b00e71f0 2024-04-17T14:40:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a800c940 con 0x7f38b00e71f0 2024-04-17T14:40:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800cd30 con 0x7f38b00e71f0 2024-04-17T14:40:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b017c750 con 0x7f38b00e71f0 2024-04-17T14:40:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b00e35c0 con 0x7f38b00e71f0 2024-04-17T14:40:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.471+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38b00052d0 con 0x7f38b00e71f0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5ca800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 0x7fb5cc15e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48724/0 (socket says 172.21.15.16:48724) 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5ca800640 1 -- 172.21.15.16:0/3297592789 learned_addr learned my addr 172.21.15.16:0/3297592789 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0a5df0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0b2070 con 0x7fb5d0156cf0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc004a30 con 0x7fb5d0156cf0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d00ce3d0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d01f8550 con 0x7fb5d0156cf0 2024-04-17T14:40:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.475+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5d00761a0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.479+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92380c3020 con 0x7f92500c8760 2024-04-17T14:40:10.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 --> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac700b1500 con 0x7fac4c0705d0 2024-04-17T14:40:10.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7f9246a00640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f922c0683d0 0x7f922c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac67400640 1 -- 172.21.15.16:0/3709003108 <== osd.6 v2:172.21.15.67:6826/3773130679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac700b1500 con 0x7fac4c0705d0 2024-04-17T14:40:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7f924ea00640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f922c0683d0 0x7f922c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7fac4c0705d0 msgr2=0x7fac4c0729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7fac4c0705d0 0x7fac4c0729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac4c0683d0 msgr2=0x7fac4c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac4c0683d0 0x7fac4c06a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac700c9da0 tx=0x7fac58006f90 comp rx=0 tx=0).stop 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 msgr2=0x7fac70150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 --2- 172.21.15.16:0/3709003108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac700b1fc0 0x7fac70150780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac6001cdc0 tx=0x7fac6001ad60 comp rx=0 tx=0).stop 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac6fe00640 1 -- 172.21.15.16:0/3709003108 reap_dead start 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 shutdown_connections 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 >> 172.21.15.16:0/3709003108 conn(0x7fac70062ab0 msgr2=0x7fac7015a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 shutdown_connections 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fac75000640 1 -- 172.21.15.16:0/3709003108 wait complete. 2024-04-17T14:40:10.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7f924ea00640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f922c0683d0 0x7f922c06a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9240009690 tx=0x7f9240006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fb5ca800640 1 -- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5cc1f32c0 msgr2=0x7fb5cc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fb5ca800640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb5cc1f32c0 0x7fb5cc153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fb5ca800640 1 -- 172.21.15.16:0/3297592789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 msgr2=0x7fb5cc0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fb5ca800640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5b00051d0 0x7fb5cc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.483+0000 7fb5ca800640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc152d50 con 0x7fb5cc153740 2024-04-17T14:40:10.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.487+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b0040 con 0x7f04b806bc90 2024-04-17T14:40:10.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.487+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac0b9070 con 0x7f04b806bc90 2024-04-17T14:40:10.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.487+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b8147d70 con 0x7f04b806bc90 2024-04-17T14:40:10.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.487+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b4650 con 0x7f04b806bc90 2024-04-17T14:40:10.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.487+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b81f72c0 con 0x7f04b806bc90 2024-04-17T14:40:10.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.491+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04b80761a0 con 0x7f04b806bc90 2024-04-17T14:40:10.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.495+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2de00b0bd0 con 0x7f2df015fe80 2024-04-17T14:40:10.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.495+0000 7f2de7e00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2dd00683b0 0x7f2dd006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.495+0000 7f2defe00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2dd00683b0 0x7f2dd006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.499+0000 7f2defe00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2dd00683b0 0x7f2dd006a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2de800ab90 tx=0x7f2de8009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.503 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:10.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9238006fc0 con 0x7f92500c8760 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f9246a00640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7f922c070630 0x7f922c072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f922c073120 con 0x7f922c070630 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92380f1290 con 0x7f92500c8760 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2de00f28b0 con 0x7f2df015fe80 2024-04-17T14:40:10.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f924f400640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7f922c070630 0x7f922c072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f2de7e00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f2dd0070610 0x7f2dd0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2de00b2e90 con 0x7f2dd0070610 2024-04-17T14:40:10.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2de00f0ab0 con 0x7f2df015fe80 2024-04-17T14:40:10.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.503+0000 7f2def400640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f2dd0070610 0x7f2dd0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.507+0000 7f924f400640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7f922c070630 0x7f922c072a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.507+0000 7f2def400640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f2dd0070610 0x7f2dd0072a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.507+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== osd.2 v2:172.21.15.16:6800/2077249539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f922c073120 con 0x7f922c070630 2024-04-17T14:40:10.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.507+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== osd.3 v2:172.21.15.16:6816/274422145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2de00b2e90 con 0x7f2dd0070610 2024-04-17T14:40:10.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 --> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92500c8540 con 0x7f922c070630 2024-04-17T14:40:10.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9246a00640 1 -- 172.21.15.16:0/1462954168 <== osd.2 v2:172.21.15.16:6800/2077249539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92500c8540 con 0x7f922c070630 2024-04-17T14:40:10.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 --> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2df00cc780 con 0x7f2dd0070610 2024-04-17T14:40:10.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7f922c070630 msgr2=0x7f922c072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7f922c070630 0x7f922c072a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f922c0683d0 msgr2=0x7f922c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f922c0683d0 0x7f922c06a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9240009690 tx=0x7f9240006c00 comp rx=0 tx=0).stop 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 msgr2=0x7f92501f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 --2- 172.21.15.16:0/1462954168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92500c8760 0x7f92501f1760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92380b3040 tx=0x7f923801ca80 comp rx=0 tx=0).stop 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f924f400640 1 -- 172.21.15.16:0/1462954168 reap_dead start 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2de7e00640 1 -- 172.21.15.16:0/4176059423 <== osd.3 v2:172.21.15.16:6816/274422145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2df00cc780 con 0x7f2dd0070610 2024-04-17T14:40:10.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 shutdown_connections 2024-04-17T14:40:10.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 >> 172.21.15.16:0/1462954168 conn(0x7f925006ba30 msgr2=0x7f92500722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 shutdown_connections 2024-04-17T14:40:10.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f9255600640 1 -- 172.21.15.16:0/1462954168 wait complete. 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f2dd0070610 msgr2=0x7f2dd0072a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f2dd0070610 0x7f2dd0072a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2dd00683b0 msgr2=0x7f2dd006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2dd00683b0 0x7f2dd006a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2de800ab90 tx=0x7f2de8009250 comp rx=0 tx=0).stop 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 msgr2=0x7f2df00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 --2- 172.21.15.16:0/4176059423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df015fe80 0x7f2df00cfaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001bab0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df4a00640 1 -- 172.21.15.16:0/4176059423 reap_dead start 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 shutdown_connections 2024-04-17T14:40:10.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 >> 172.21.15.16:0/4176059423 conn(0x7f2df0062450 msgr2=0x7f2df015a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.523+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 shutdown_connections 2024-04-17T14:40:10.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.527+0000 7f2df6a00640 1 -- 172.21.15.16:0/4176059423 wait complete. 2024-04-17T14:40:10.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.551+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04ac0b47f0 con 0x7f04b806bc90 2024-04-17T14:40:10.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.555+0000 7f04b5600640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0498068400 0x7f049806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.555+0000 7f04bce00640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0498068400 0x7f049806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.555 INFO:teuthology.orchestra.run.smithi016.stdout:64424509454 2024-04-17T14:40:10.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T14:40:10.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.555+0000 7f04bce00640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0498068400 0x7f049806a8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04b8072de0 tx=0x7f04a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.557 INFO:teuthology.orchestra.run.smithi016.stdout:64424509456 2024-04-17T14:40:10.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T14:40:10.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f04ac0eeeb0 con 0x7f04b806bc90 2024-04-17T14:40:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04b5600640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f0498070660 0x7f0498072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04ac0ab600 con 0x7f0498070660 2024-04-17T14:40:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04be200640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f0498070660 0x7f0498072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04ac0ed0b0 con 0x7f04b806bc90 2024-04-17T14:40:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.559+0000 7f04be200640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f0498070660 0x7f0498072a80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.563+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== osd.1 v2:172.21.15.16:6824/1749404511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04ac0ab600 con 0x7f0498070660 2024-04-17T14:40:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.575+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5bc004bd0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.575+0000 7fb5ccc00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5b0068400 0x7fb5b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.575+0000 7fb5d4e00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5b0068400 0x7fb5b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.575+0000 7fb5d4e00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5b0068400 0x7fb5b006a8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4006e90 tx=0x7fb5c4006e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 --> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04b81f7580 con 0x7f0498070660 2024-04-17T14:40:10.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04b5600640 1 -- 172.21.15.16:0/1604168300 <== osd.1 v2:172.21.15.16:6824/1749404511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04b81f7580 con 0x7f0498070660 2024-04-17T14:40:10.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f0498070660 msgr2=0x7f0498072a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f0498070660 0x7f0498072a80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0498068400 msgr2=0x7f049806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0498068400 0x7f049806a8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04b8072de0 tx=0x7f04a4009040 comp rx=0 tx=0).stop 2024-04-17T14:40:10.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 msgr2=0x7f04b81f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04bec00640 1 --2- 172.21.15.16:0/1604168300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04b806bc90 0x7f04b81f6c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04ac019090 tx=0x7f04ac019220 comp rx=0 tx=0).stop 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.591+0000 7f04be200640 1 -- 172.21.15.16:0/1604168300 reap_dead start 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.595+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 shutdown_connections 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.595+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 >> 172.21.15.16:0/1604168300 conn(0x7f04b80c8b80 msgr2=0x7f04b8143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.595+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 shutdown_connections 2024-04-17T14:40:10.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.595+0000 7f04bec00640 1 -- 172.21.15.16:0/1604168300 wait complete. 2024-04-17T14:40:10.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.615+0000 7fb5ca800640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 0x7fb5cc15e720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5c401d020 tx=0x7fb5b0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.619+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38a801a070 con 0x7f38b00e71f0 2024-04-17T14:40:10.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.619+0000 7f38aea00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f38980683d0 0x7f389806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.619+0000 7f38b6a00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f38980683d0 0x7f389806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.619+0000 7f38b6a00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f38980683d0 0x7f389806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b8074c50 tx=0x7f38b806e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.623 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:10.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T14:40:10.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f38a8055070 con 0x7f38b00e71f0 2024-04-17T14:40:10.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38aea00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f38980705d0 0x7f38980729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38a8013e50 con 0x7f38980705d0 2024-04-17T14:40:10.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38b6000640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f38980705d0 0x7f38980729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38a8053270 con 0x7f38b00e71f0 2024-04-17T14:40:10.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.627+0000 7f38b6000640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f38980705d0 0x7f38980729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.631+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== osd.0 v2:172.21.15.16:6805/2573416499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38a8013e50 con 0x7f38980705d0 2024-04-17T14:40:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb5bc0ee5d0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5ccc00640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7fb5b0070660 0x7fb5b0072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5bc0b6e80 con 0x7fb5b0070660 2024-04-17T14:40:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5bc0ec7d0 con 0x7fb5d0156cf0 2024-04-17T14:40:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5d5800640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7fb5b0070660 0x7fb5b0072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5d5800640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7fb5b0070660 0x7fb5b0072a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.639+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== osd.7 v2:172.21.15.67:6802/1496189584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5bc0b6e80 con 0x7fb5b0070660 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 Processor -- start 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 -- start start 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 0x7f88b015c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b006e400 con 0x7f88b00c5420 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b00c8ea0 con 0x7f88b00ca2b0 2024-04-17T14:40:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.643+0000 7f88b4e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f88b006e1d0 con 0x7f88b0152ec0 2024-04-17T14:40:10.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7f88ade00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 0x7f88b015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7f88ad400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f88b00c5420 0x7f88b00c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35704/0 (socket says 172.21.15.16:35704) 2024-04-17T14:40:10.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7f88ad400640 1 -- 172.21.15.16:0/2334993754 learned_addr learned my addr 172.21.15.16:0/2334993754 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4001a90 con 0x7fb5cc153740 2024-04-17T14:40:10.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c4003980 con 0x7fb5cc153740 2024-04-17T14:40:10.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4006d80 con 0x7fb5cc153740 2024-04-17T14:40:10.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7fb5d1200640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc153bc0 con 0x7fb5cc153740 2024-04-17T14:40:10.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.647+0000 7fb5d1200640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc1f0080 con 0x7fb5cc153740 2024-04-17T14:40:10.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.651+0000 7fb5d1200640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5cc076280 con 0x7fb5cc153740 2024-04-17T14:40:10.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.651+0000 7f88aca00640 1 -- 172.21.15.16:0/2334993754 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372926763 0 0) 0x7f88b006e400 con 0x7f88b00c5420 2024-04-17T14:40:10.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.651+0000 7f88aca00640 1 -- 172.21.15.16:0/2334993754 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8894003530 con 0x7f88b00c5420 2024-04-17T14:40:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.655+0000 7f88ade00640 1 -- 172.21.15.16:0/2334993754 >> v1:172.21.15.67:6789/0 conn(0x7f88b00ca2b0 legacy=0x7f88b01634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.655+0000 7f88ade00640 1 -- 172.21.15.16:0/2334993754 >> v1:172.21.15.16:6789/0 conn(0x7f88b00c5420 legacy=0x7f88b00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.655+0000 7f88ade00640 1 -- 172.21.15.16:0/2334993754 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b00c9160 con 0x7f88b0152ec0 2024-04-17T14:40:10.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.659+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 --> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38b00493e0 con 0x7f38980705d0 2024-04-17T14:40:10.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38aea00640 1 -- 172.21.15.16:0/1954928598 <== osd.0 v2:172.21.15.16:6805/2573416499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38b00493e0 con 0x7f38980705d0 2024-04-17T14:40:10.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f38980705d0 msgr2=0x7f38980729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f38980705d0 0x7f38980729f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 --> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5d00b1680 con 0x7fb5b0070660 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f38980683d0 msgr2=0x7f389806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f38980683d0 0x7f389806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b8074c50 tx=0x7f38b806e040 comp rx=0 tx=0).stop 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 msgr2=0x7f38b017bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 --2- 172.21.15.16:0/1954928598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b00e71f0 0x7f38b017bda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e8b0 tx=0x7f38a800ed70 comp rx=0 tx=0).stop 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7400640 1 -- 172.21.15.16:0/1954928598 reap_dead start 2024-04-17T14:40:10.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f88ade00640 1 --2- 172.21.15.16:0/2334993754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 0x7f88b015c130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88980097f0 tx=0x7f889801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb50a0ea67a9509d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 shutdown_connections 2024-04-17T14:40:10.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 >> 172.21.15.16:0/1954928598 conn(0x7f38b0050190 msgr2=0x7f38b004df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5ccc00640 1 -- 172.21.15.16:0/1450579755 <== osd.7 v2:172.21.15.67:6802/1496189584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5d00b1680 con 0x7fb5b0070660 2024-04-17T14:40:10.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 shutdown_connections 2024-04-17T14:40:10.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7f38b7e00640 1 -- 172.21.15.16:0/1954928598 wait complete. 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7fb5b0070660 msgr2=0x7fb5b0072a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7fb5b0070660 0x7fb5b0072a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5b0068400 msgr2=0x7fb5b006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5b0068400 0x7fb5b006a8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4006e90 tx=0x7fb5c4006e00 comp rx=0 tx=0).stop 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 msgr2=0x7fb5d0157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 --2- 172.21.15.16:0/1450579755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5d0156cf0 0x7fb5d0157440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0ab040 tx=0x7fb5b8005840 comp rx=0 tx=0).stop 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d5800640 1 -- 172.21.15.16:0/1450579755 reap_dead start 2024-04-17T14:40:10.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 shutdown_connections 2024-04-17T14:40:10.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 >> 172.21.15.16:0/1450579755 conn(0x7fb5d0071440 msgr2=0x7fb5d015b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 shutdown_connections 2024-04-17T14:40:10.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.663+0000 7fb5d6200640 1 -- 172.21.15.16:0/1450579755 wait complete. 2024-04-17T14:40:10.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.675+0000 7f88aca00640 1 -- 172.21.15.16:0/2334993754 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980b5070 con 0x7f88b0152ec0 2024-04-17T14:40:10.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.675+0000 7f88aca00640 1 -- 172.21.15.16:0/2334993754 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88980a89d0 con 0x7f88b0152ec0 2024-04-17T14:40:10.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.675+0000 7f88aca00640 1 -- 172.21.15.16:0/2334993754 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980b5070 con 0x7f88b0152ec0 2024-04-17T14:40:10.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.679+0000 7f88b4e00640 1 -- 172.21.15.16:0/2334993754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 msgr2=0x7f88b015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.679+0000 7f88b4e00640 1 --2- 172.21.15.16:0/2334993754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 0x7f88b015c130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88980097f0 tx=0x7f889801ecf0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.679+0000 7f88b4e00640 1 -- 172.21.15.16:0/2334993754 shutdown_connections 2024-04-17T14:40:10.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.679+0000 7f88b4e00640 1 --2- 172.21.15.16:0/2334993754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b0152ec0 0x7f88b015c130 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.679+0000 7f88b4e00640 1 -- 172.21.15.16:0/2334993754 >> 172.21.15.16:0/2334993754 conn(0x7f88b0062850 msgr2=0x7f88b006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.683+0000 7f88b4e00640 1 -- 172.21.15.16:0/2334993754 shutdown_connections 2024-04-17T14:40:10.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.683+0000 7f88b4e00640 1 -- 172.21.15.16:0/2334993754 wait complete. 2024-04-17T14:40:10.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.687+0000 7f88b4e00640 1 Processor -- start 2024-04-17T14:40:10.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.687+0000 7f4a37200640 1 Processor -- start 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.687+0000 7f4a37200640 1 -- start start 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a37200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a380718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a37200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4a3806cb20 0x7f4a38150650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a37200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a38157660 con 0x7f4a3806d5e0 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a37200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4a38157bc0 con 0x7f4a3806cb20 2024-04-17T14:40:10.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a37200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4a38157900 con 0x7f4a3806bc90 2024-04-17T14:40:10.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 -- start start 2024-04-17T14:40:10.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f4a36800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4a3806cb20 0x7f4a38150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b00ca2b0 0x7f88b0151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88b0152ec0 0x7f88b00c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88b0158e90 con 0x7f88b00c5420 2024-04-17T14:40:10.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88b01532a0 con 0x7f88b0152ec0 2024-04-17T14:40:10.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.691+0000 7f88b4e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f88b0159170 con 0x7f88b00ca2b0 2024-04-17T14:40:10.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f4a35e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a380718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f4a36800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4a3806cb20 0x7f4a38150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48072/0 (socket says 172.21.15.16:48072) 2024-04-17T14:40:10.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f4a36800640 1 -- 172.21.15.16:0/2480216867 learned_addr learned my addr 172.21.15.16:0/2480216867 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f88ade00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.695 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:10.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T14:40:10.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f88ade00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48084/0 (socket says 172.21.15.16:48084) 2024-04-17T14:40:10.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f88ade00640 1 -- 172.21.15.16:0/1176271703 learned_addr learned my addr 172.21.15.16:0/1176271703 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.695+0000 7f88ad400640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b00ca2b0 0x7f88b0151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.697 INFO:teuthology.orchestra.run.smithi016.stdout:60129542157 2024-04-17T14:40:10.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T14:40:10.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f4a36800640 1 -- 172.21.15.16:0/2480216867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 msgr2=0x7f4a380718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f4a36800640 1 --2- 172.21.15.16:0/2480216867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a380718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f4a36800640 1 -- 172.21.15.16:0/2480216867 >> v1:172.21.15.67:6789/0 conn(0x7f4a3806d5e0 legacy=0x7f4a3806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f4a36800640 1 -- 172.21.15.16:0/2480216867 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a380c6bb0 con 0x7f4a3806cb20 2024-04-17T14:40:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f88ade00640 1 -- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b00ca2b0 msgr2=0x7f88b0151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f88ade00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b00ca2b0 0x7f88b0151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f88ade00640 1 -- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88b0152ec0 msgr2=0x7f88b00c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f88ade00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88b0152ec0 0x7f88b00c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.703+0000 7f88ade00640 1 -- 172.21.15.16:0/1176271703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b00aecd0 con 0x7f88b00c5420 2024-04-17T14:40:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.711+0000 7f88ade00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88980097f0 tx=0x7f889801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.711+0000 7f4a36800640 1 --2- 172.21.15.16:0/2480216867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806cb20 0x7f4a38150650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a380c9f30 tx=0x7f4a3001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88e7c7222e1090a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.719+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980bf070 con 0x7f88b00c5420 2024-04-17T14:40:10.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.719+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898004470 con 0x7f88b00c5420 2024-04-17T14:40:10.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.719+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b0150300 con 0x7f88b00c5420 2024-04-17T14:40:10.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.719+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b01508c0 con 0x7f88b00c5420 2024-04-17T14:40:10.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.719+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980b5040 con 0x7f88b00c5420 2024-04-17T14:40:10.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.723+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88880052a0 con 0x7f88b00c5420 2024-04-17T14:40:10.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a34a00640 1 -- 172.21.15.16:0/2480216867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300ad070 con 0x7f4a3806cb20 2024-04-17T14:40:10.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a34a00640 1 -- 172.21.15.16:0/2480216867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a300a7cf0 con 0x7f4a3806cb20 2024-04-17T14:40:10.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a34a00640 1 -- 172.21.15.16:0/2480216867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300b1620 con 0x7f4a3806cb20 2024-04-17T14:40:10.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 -- 172.21.15.16:0/2480216867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806cb20 msgr2=0x7f4a38150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 --2- 172.21.15.16:0/2480216867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806cb20 0x7f4a38150650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a380c9f30 tx=0x7f4a3001ed50 comp rx=0 tx=0).stop 2024-04-17T14:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 -- 172.21.15.16:0/2480216867 shutdown_connections 2024-04-17T14:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 --2- 172.21.15.16:0/2480216867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806cb20 0x7f4a38150650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 --2- 172.21.15.16:0/2480216867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a380718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.727+0000 7f4a37200640 1 -- 172.21.15.16:0/2480216867 >> 172.21.15.16:0/2480216867 conn(0x7f4a380c8b80 msgr2=0x7f4a380c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.731+0000 7f4a37200640 1 -- 172.21.15.16:0/2480216867 shutdown_connections 2024-04-17T14:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.731+0000 7f4a37200640 1 -- 172.21.15.16:0/2480216867 wait complete. 2024-04-17T14:40:10.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.731+0000 7f4a37200640 1 Processor -- start 2024-04-17T14:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.735+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5c40a6480 con 0x7fb5cc153740 2024-04-17T14:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.735+0000 7f4a37200640 1 -- start start 2024-04-17T14:40:10.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.735+0000 7fb5c2000640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5a8068400 0x7fb5a806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.735+0000 7fb5c9e00640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5a8068400 0x7fb5a806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3806cb20 0x7f4a381447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7fb5c9e00640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5a8068400 0x7fb5a806a8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0099d0 tx=0x7fb5bc004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806d5e0 0x7f4a380c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38150fa0 con 0x7f4a3806d5e0 2024-04-17T14:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3806c780 con 0x7f4a3806cb20 2024-04-17T14:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a37200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4a38151120 con 0x7f4a3806bc90 2024-04-17T14:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb5c4003b30 con 0x7fb5cc153740 2024-04-17T14:40:10.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a35e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7fb5c2000640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7fb5a8070600 0x7fb5a8072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5c40bfec0 con 0x7fb5a8070600 2024-04-17T14:40:10.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a35e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44412/0 (socket says 172.21.15.16:44412) 2024-04-17T14:40:10.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7f4a35e00640 1 -- 172.21.15.16:0/2892741340 learned_addr learned my addr 172.21.15.16:0/2892741340 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.739+0000 7fb5c3e00640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7fb5a8070600 0x7fb5a8072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.743+0000 7fb5c3e00640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7fb5a8070600 0x7fb5a8072a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.743+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5c40ecb30 con 0x7fb5cc153740 2024-04-17T14:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.743+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== osd.4 v2:172.21.15.67:6818/2915598098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5c40bfec0 con 0x7fb5a8070600 2024-04-17T14:40:10.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.751+0000 7f4a35400640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3806cb20 0x7f4a381447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.755+0000 7f4a35e00640 1 -- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3806cb20 msgr2=0x7f4a381447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.755+0000 7f4a35e00640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3806cb20 0x7f4a381447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.755+0000 7f4a35e00640 1 -- 172.21.15.16:0/2892741340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806d5e0 msgr2=0x7f4a380c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.755+0000 7f4a35e00640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806d5e0 0x7f4a380c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.755+0000 7f4a35e00640 1 -- 172.21.15.16:0/2892741340 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a380c6560 con 0x7f4a3806bc90 2024-04-17T14:40:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.759+0000 7f4a35e00640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e930 tx=0x7f4a2800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.767+0000 7fb5d1200640 1 -- 172.21.15.16:0/3297592789 --> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5cc1f0360 con 0x7fb5a8070600 2024-04-17T14:40:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5c2000640 1 -- 172.21.15.16:0/3297592789 <== osd.4 v2:172.21.15.67:6818/2915598098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5cc1f0360 con 0x7fb5a8070600 2024-04-17T14:40:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7fb5a8070600 msgr2=0x7fb5a8072a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7fb5a8070600 0x7fb5a8072a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5a8068400 msgr2=0x7fb5a806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb5a8068400 0x7fb5a806a8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0099d0 tx=0x7fb5bc004740 comp rx=0 tx=0).stop 2024-04-17T14:40:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 msgr2=0x7fb5cc15e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 --2- 172.21.15.16:0/3297592789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5cc153740 0x7fb5cc15e720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5c401d020 tx=0x7fb5b0005840 comp rx=0 tx=0).stop 2024-04-17T14:40:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5ca800640 1 -- 172.21.15.16:0/3297592789 reap_dead start 2024-04-17T14:40:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 shutdown_connections 2024-04-17T14:40:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 >> 172.21.15.16:0/3297592789 conn(0x7fb5cc062620 msgr2=0x7fb5cc0d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.771+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28017070 con 0x7f4a3806bc90 2024-04-17T14:40:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2800c980 con 0x7f4a3806bc90 2024-04-17T14:40:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800cd30 con 0x7f4a3806bc90 2024-04-17T14:40:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 shutdown_connections 2024-04-17T14:40:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a380c5fe0 con 0x7f4a3806bc90 2024-04-17T14:40:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7fb5bb400640 1 -- 172.21.15.16:0/3297592789 wait complete. 2024-04-17T14:40:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a380c6280 con 0x7f4a3806bc90 2024-04-17T14:40:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.775+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a380761a0 con 0x7f4a3806bc90 2024-04-17T14:40:10.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 Processor -- start 2024-04-17T14:40:10.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 -- start start 2024-04-17T14:40:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fd00c5420 0x7f3fd015c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fd00ca2b0 0x7f3fd0159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd006e400 con 0x7f3fd0152ec0 2024-04-17T14:40:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd006e1d0 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.779+0000 7f3fd5c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd01532a0 con 0x7f3fd00c5420 2024-04-17T14:40:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.783+0000 7f3fce000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fd00c5420 0x7f3fd015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.783+0000 7fd7bd400640 1 Processor -- start 2024-04-17T14:40:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.783+0000 7f3fce000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fd00c5420 0x7f3fd015c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48770/0 (socket says 172.21.15.16:48770) 2024-04-17T14:40:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.783+0000 7fd7bd400640 1 -- start start 2024-04-17T14:40:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.783+0000 7f3fce000640 1 -- 172.21.15.16:0/4140205975 learned_addr learned my addr 172.21.15.16:0/4140205975 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.787+0000 7fd7bd400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b80c4200 0x7fd7b815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.787+0000 7fd7bd400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b815eb80 con 0x7fd7b80c9690 2024-04-17T14:40:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.787+0000 7fd7bd400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b815ee60 con 0x7fd7b80c9a70 2024-04-17T14:40:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.787+0000 7fd7bd400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b815aed0 con 0x7fd7b80c4200 2024-04-17T14:40:10.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.791+0000 7f3fce000640 1 -- 172.21.15.16:0/4140205975 >> v2:172.21.15.16:3300/0 conn(0x7f3fd00ca2b0 msgr2=0x7f3fd0159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.791+0000 7f3fce000640 1 --2- 172.21.15.16:0/4140205975 >> v2:172.21.15.16:3300/0 conn(0x7f3fd00ca2b0 0x7f3fd0159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.791+0000 7f3fce000640 1 -- 172.21.15.16:0/4140205975 >> v1:172.21.15.16:6789/0 conn(0x7f3fd0152ec0 legacy=0x7f3fd00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.791+0000 7f3fce000640 1 -- 172.21.15.16:0/4140205975 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd00c8ea0 con 0x7f3fd00c5420 2024-04-17T14:40:10.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.795+0000 7fd7afe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7b80c9a70 0x7fd7b8163760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:32840/0 (socket says 172.21.15.16:32840) 2024-04-17T14:40:10.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.795+0000 7fd7afe00640 1 -- 172.21.15.16:0/2505454436 learned_addr learned my addr 172.21.15.16:0/2505454436 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.799 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:10.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T14:40:10.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.803+0000 7f3fce000640 1 --2- 172.21.15.16:0/4140205975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00c5420 0x7f3fd015c130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00cf4d0 tx=0x7f3fbc01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405fe5782e260551 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.819+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374186637 0 0) 0x7fd7b815ee60 con 0x7fd7b80c9a70 2024-04-17T14:40:10.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.819+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd79c003530 con 0x7fd7b80c9a70 2024-04-17T14:40:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fcd600640 1 -- 172.21.15.16:0/4140205975 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0b5070 con 0x7f3fd00c5420 2024-04-17T14:40:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fcd600640 1 -- 172.21.15.16:0/4140205975 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0a89d0 con 0x7f3fd00c5420 2024-04-17T14:40:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fcd600640 1 -- 172.21.15.16:0/4140205975 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0a8da0 con 0x7f3fd00c5420 2024-04-17T14:40:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 -- 172.21.15.16:0/4140205975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00c5420 msgr2=0x7f3fd015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/4140205975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00c5420 0x7f3fd015c130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00cf4d0 tx=0x7f3fbc01ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 -- 172.21.15.16:0/4140205975 shutdown_connections 2024-04-17T14:40:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/4140205975 >> v2:172.21.15.16:3300/0 conn(0x7f3fd00ca2b0 0x7f3fd0159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/4140205975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00c5420 0x7f3fd015c130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 -- 172.21.15.16:0/4140205975 >> 172.21.15.16:0/4140205975 conn(0x7f3fd0062850 msgr2=0x7f3fd006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:10.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 -- 172.21.15.16:0/4140205975 shutdown_connections 2024-04-17T14:40:10.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.823+0000 7f3fd5c00640 1 -- 172.21.15.16:0/4140205975 wait complete. 2024-04-17T14:40:10.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 Processor -- start 2024-04-17T14:40:10.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 -- start start 2024-04-17T14:40:10.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fd00c5420 0x7f3fd0152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fd0152ec0 0x7f3fd00c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0158e90 con 0x7f3fd0152ec0 2024-04-17T14:40:10.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd00c9440 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.827+0000 7f3fd5c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd0159170 con 0x7f3fd00c5420 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432206325 0 0) 0x7fd79c003530 con 0x7fd7b80c9a70 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b80c4200 msgr2=0x7fd7b815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7b80c4200 0x7fd7b815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 >> v1:172.21.15.16:6789/0 conn(0x7fd7b80c9690 legacy=0x7fd7b80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b815f140 con 0x7fd7b80c9a70 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fd7a0001680 con 0x7fd7b80c9a70 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 >> v1:172.21.15.67:6789/0 conn(0x7fd7b80c9a70 legacy=0x7fd7b8163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd79c0039c0 0x7fd79c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c004810 0x7fd79c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd79c005220 0x7fd79c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b815aed0 con 0x7fd79c005220 2024-04-17T14:40:10.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c00c100 con 0x7fd79c0039c0 2024-04-17T14:40:10.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c00c300 con 0x7fd79c004810 2024-04-17T14:40:10.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a2801a070 con 0x7f4a3806bc90 2024-04-17T14:40:10.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7f3fce000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7f4a2e000640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 0x7f4a1806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.839+0000 7f4a35400640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 0x7f4a1806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.843+0000 7f4a35400640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 0x7f4a1806a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4a380c6950 tx=0x7f4a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.843+0000 7f3fce000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:48776/0 (socket says 172.21.15.16:48776) 2024-04-17T14:40:10.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.843+0000 7f3fce000640 1 -- 172.21.15.16:0/2919712012 learned_addr learned my addr 172.21.15.16:0/2919712012 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.847+0000 7fd7b6800640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd79c0039c0 0x7fd79c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.855+0000 7f3fce000640 1 -- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fd00c5420 msgr2=0x7f3fd0152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.855+0000 7f3fce000640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fd00c5420 0x7f3fd0152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.855+0000 7f3fce000640 1 -- 172.21.15.16:0/2919712012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fd0152ec0 msgr2=0x7f3fd00c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.855+0000 7f3fce000640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fd0152ec0 0x7f3fd00c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.855+0000 7f3fce000640 1 -- 172.21.15.16:0/2919712012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd0155d00 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.863+0000 7f3fce000640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b3040 tx=0x7f3fbc01ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.863+0000 7f8ae9400640 1 Processor -- start 2024-04-17T14:40:10.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.863+0000 7f8ae9400640 1 -- start start 2024-04-17T14:40:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.867+0000 7f8ae9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae4070d90 0x7f8ae4157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.867+0000 7f8ae9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ae40c8a80 0x7f8ae4162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.867+0000 7f8ae9400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae40739e0 con 0x7f8ae41519c0 2024-04-17T14:40:10.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.867+0000 7f8ae9400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae40c85f0 con 0x7f8ae40c8a80 2024-04-17T14:40:10.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.867+0000 7f8ae9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae40c46a0 con 0x7f8ae4070d90 2024-04-17T14:40:10.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.871+0000 7fd7b6800640 1 -- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c004810 msgr2=0x7fd79c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.871+0000 7fd7b6800640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c004810 0x7fd79c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.871+0000 7fd7b6800640 1 -- 172.21.15.16:0/2505454436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd79c005220 msgr2=0x7fd79c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:10.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.871+0000 7fd7b6800640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd79c005220 0x7fd79c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:10.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.871+0000 7fd7b6800640 1 -- 172.21.15.16:0/2505454436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b815f140 con 0x7fd79c0039c0 2024-04-17T14:40:10.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7f8ae3e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8ae41519c0 0x7f8ae40c6310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:33102/0 (socket says 172.21.15.16:33102) 2024-04-17T14:40:10.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7f8ae3e00640 1 -- 172.21.15.16:0/3477273068 learned_addr learned my addr 172.21.15.16:0/3477273068 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:10.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88980a89d0 con 0x7f88b00c5420 2024-04-17T14:40:10.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7f88a6000640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 0x7f888c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7fd3c6600640 1 Processor -- start 2024-04-17T14:40:10.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7fb09f200640 1 Processor -- start 2024-04-17T14:40:10.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.883+0000 7fd3c6600640 1 -- start start 2024-04-17T14:40:10.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 -- start start 2024-04-17T14:40:10.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7f88ad400640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 0x7f888c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:10.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7f88ad400640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 0x7f888c06a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88b00cdbe0 tx=0x7f88a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 0x7fb0a00ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0a006cf10 0x7fb0a00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a01626a0 con 0x7fb0a00c7b00 2024-04-17T14:40:10.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a006c370 con 0x7fb0a006cf10 2024-04-17T14:40:10.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fb09f200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0162980 con 0x7fb0a0159230 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c0153050 0x7fd3c0159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd3c6600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd3c00c3060 0x7fd3c00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd3c6600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c0153430 con 0x7fd3c00c8d20 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd3c6600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c006ef10 con 0x7fd3c00c3060 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd3c6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c006ff20 con 0x7fd3c0153050 2024-04-17T14:40:10.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.887+0000 7fd7b6800640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd79c0039c0 0x7fd79c003dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001650 tx=0x7fd7a801c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b66cee29f95f1e74 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:10.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0c0070 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0b08d0 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0b5040 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd0155f70 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01535f0 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.891+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd0076280 con 0x7f3fd00ca2b0 2024-04-17T14:40:10.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 Processor -- start 2024-04-17T14:40:10.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 -- start start 2024-04-17T14:40:10.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbac006baa0 0x7fbac0062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:10.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac006d130 con 0x7fbac0155150 2024-04-17T14:40:10.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbac006d3a0 con 0x7fbac006baa0 2024-04-17T14:40:10.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:10.955+0000 7fbac8800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fbac015ae10 con 0x7fbac0154d70 2024-04-17T14:40:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.079+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f88980f1cd0 con 0x7f88b00c5420 2024-04-17T14:40:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.083+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8898018850 con 0x7f88b00c5420 2024-04-17T14:40:11.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.135+0000 7f8ae8a00640 1 --2- 172.21.15.16:0/3477273068 >> v2:172.21.15.16:3300/0 conn(0x7f8ae40c8a80 0x7f8ae4162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.139+0000 7fb09d400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb0a00c7b00 0x7fb0a006c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43188/0 (socket says 172.21.15.16:43188) 2024-04-17T14:40:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.139+0000 7fb09d400640 1 -- 172.21.15.16:0/1998918230 learned_addr learned my addr 172.21.15.16:0/1998918230 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.139+0000 7fd3bea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd3c00c3060 0x7fd3c00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7f8ae8a00640 1 -- 172.21.15.16:0/3477273068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae4070d90 msgr2=0x7f8ae4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7f8ae8a00640 1 --2- 172.21.15.16:0/3477273068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae4070d90 0x7f8ae4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7f8ae8a00640 1 -- 172.21.15.16:0/3477273068 >> v1:172.21.15.67:6789/0 conn(0x7f8ae41519c0 legacy=0x7f8ae40c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7f8ae8a00640 1 -- 172.21.15.16:0/3477273068 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae40c4980 con 0x7f8ae40c8a80 2024-04-17T14:40:11.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7fd3bea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd3c00c3060 0x7fd3c00c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60998/0 (socket says 172.21.15.16:60998) 2024-04-17T14:40:11.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.143+0000 7fd3bea00640 1 -- 172.21.15.16:0/956576036 learned_addr learned my addr 172.21.15.16:0/956576036 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.147+0000 7fd3bea00640 1 -- 172.21.15.16:0/956576036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c0153050 msgr2=0x7fd3c0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.147+0000 7fd3bea00640 1 --2- 172.21.15.16:0/956576036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c0153050 0x7fd3c0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.147+0000 7fd3bea00640 1 -- 172.21.15.16:0/956576036 >> v1:172.21.15.67:6789/0 conn(0x7fd3c00c8d20 legacy=0x7fd3c00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.147+0000 7fd3bea00640 1 -- 172.21.15.16:0/956576036 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c0159cc0 con 0x7fd3c00c3060 2024-04-17T14:40:11.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.151+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615292065 0 0) 0x7fb0a01626a0 con 0x7fb0a00c7b00 2024-04-17T14:40:11.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.151+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb084003530 con 0x7fb0a00c7b00 2024-04-17T14:40:11.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.155+0000 7fd3bea00640 1 --2- 172.21.15.16:0/956576036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c3060 0x7fd3c00c87e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009870 tx=0x7fd3ac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1abc48c4169537 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.155+0000 7f8ae8a00640 1 --2- 172.21.15.16:0/3477273068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae40c8a80 0x7f8ae4162100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8ad72fd8438698 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4133544474 0 0) 0x7fb084003530 con 0x7fb0a00c7b00 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 msgr2=0x7fb0a00ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 0x7fb0a00ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 >> v2:172.21.15.67:3300/0 conn(0x7fb0a006cf10 msgr2=0x7fb0a00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 --2- 172.21.15.16:0/1998918230 >> v2:172.21.15.67:3300/0 conn(0x7fb0a006cf10 0x7fb0a00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a0162c60 con 0x7fb0a00c7b00 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fb08c001680 con 0x7fb0a00c7b00 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 >> v1:172.21.15.16:6789/0 conn(0x7fb0a00c7b00 legacy=0x7fb0a006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 0x7fb0840039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb084004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb084004e70 0x7fb08400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a006c370 con 0x7fb084004120 2024-04-17T14:40:11.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0162980 con 0x7fb084004e70 2024-04-17T14:40:11.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840055f0 con 0x7fb0a0159230 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7f8ae2a00640 1 -- 172.21.15.16:0/3477273068 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0b4070 con 0x7f8ae40c8a80 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7f8ae2a00640 1 -- 172.21.15.16:0/3477273068 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8adc0af600 con 0x7f8ae40c8a80 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.163+0000 7f8ae2a00640 1 -- 172.21.15.16:0/3477273068 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0af9d0 con 0x7f8ae40c8a80 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- 172.21.15.16:0/3477273068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae40c8a80 msgr2=0x7f8ae4162100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- 172.21.15.16:0/3477273068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae40c8a80 0x7f8ae4162100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc01f150 comp rx=0 tx=0).stop 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- 172.21.15.16:0/3477273068 shutdown_connections 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- 172.21.15.16:0/3477273068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae40c8a80 0x7f8ae4162100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- 172.21.15.16:0/3477273068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae4070d90 0x7f8ae4157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- 172.21.15.16:0/3477273068 >> 172.21.15.16:0/3477273068 conn(0x7f8ae40728a0 msgr2=0x7f8ae4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- 172.21.15.16:0/3477273068 shutdown_connections 2024-04-17T14:40:11.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- 172.21.15.16:0/3477273068 wait complete. 2024-04-17T14:40:11.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 Processor -- start 2024-04-17T14:40:11.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- start start 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae40c8a80 0x7f8ae41f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae41519c0 0x7f8ae41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40c8ed0 con 0x7f8ae4070d90 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40c8280 con 0x7f8ae41519c0 2024-04-17T14:40:11.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.167+0000 7f8ae9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae4151da0 con 0x7f8ae40c8a80 2024-04-17T14:40:11.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.171+0000 7fb09d400640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb084004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.171+0000 7f8ae3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.171+0000 7f8ae3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32776/0 (socket says 172.21.15.16:32776) 2024-04-17T14:40:11.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.171+0000 7f8ae3e00640 1 -- 172.21.15.16:0/2363442287 learned_addr learned my addr 172.21.15.16:0/2363442287 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fb09d400640 1 -- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 msgr2=0x7fb0840039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fb09d400640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a0159230 0x7fb0840039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fb09d400640 1 -- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb084004e70 msgr2=0x7fb08400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fb09d400640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb084004e70 0x7fb08400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fb09d400640 1 -- 172.21.15.16:0/1998918230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb084003530 con 0x7fb084004120 2024-04-17T14:40:11.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fd3be000640 1 -- 172.21.15.16:0/956576036 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0b5070 con 0x7fd3c00c3060 2024-04-17T14:40:11.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fd3be000640 1 -- 172.21.15.16:0/956576036 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0a89d0 con 0x7fd3c00c3060 2024-04-17T14:40:11.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.179+0000 7fd3be000640 1 -- 172.21.15.16:0/956576036 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0a8da0 con 0x7fd3c00c3060 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- 172.21.15.16:0/956576036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c3060 msgr2=0x7fd3c00c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 --2- 172.21.15.16:0/956576036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c3060 0x7fd3c00c87e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009870 tx=0x7fd3ac01ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- 172.21.15.16:0/956576036 shutdown_connections 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 --2- 172.21.15.16:0/956576036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c3060 0x7fd3c00c87e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 --2- 172.21.15.16:0/956576036 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c0153050 0x7fd3c0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- 172.21.15.16:0/956576036 >> 172.21.15.16:0/956576036 conn(0x7fd3c006ba30 msgr2=0x7fd3c006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- 172.21.15.16:0/956576036 shutdown_connections 2024-04-17T14:40:11.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- 172.21.15.16:0/956576036 wait complete. 2024-04-17T14:40:11.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 Processor -- start 2024-04-17T14:40:11.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7fd3c6600640 1 -- start start 2024-04-17T14:40:11.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7f8ae3e00640 1 -- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae40c8a80 msgr2=0x7f8ae41f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7f8ae3e00640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae40c8a80 0x7f8ae41f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7f8ae3e00640 1 -- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae41519c0 msgr2=0x7f8ae41528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7f8ae3e00640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae41519c0 0x7f8ae41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.183+0000 7f8ae3e00640 1 -- 172.21.15.16:0/2363442287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae41f4d80 con 0x7f8ae4070d90 2024-04-17T14:40:11.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c8d20 0x7fd3c00ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3c0153050 0x7fd3c0145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c006f440 con 0x7fd3c00c8d20 2024-04-17T14:40:11.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c006f160 con 0x7fd3c0153050 2024-04-17T14:40:11.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.187+0000 7fd3c6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c006f720 con 0x7fd3c00c3060 2024-04-17T14:40:11.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.191+0000 7f8ae3e00640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c370 tx=0x7f8ad400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7fb09d400640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb084004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00c190 tx=0x7fb08c01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361f4a1927f732b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4017070 con 0x7f8ae4070d90 2024-04-17T14:40:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad4005cf0 con 0x7f8ae4070d90 2024-04-17T14:40:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40072f0 con 0x7f8ae4070d90 2024-04-17T14:40:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae41f08f0 con 0x7f8ae4070d90 2024-04-17T14:40:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae4157980 con 0x7f8ae4070d90 2024-04-17T14:40:11.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.195+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae40761a0 con 0x7f8ae4070d90 2024-04-17T14:40:11.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.203+0000 7fd3bea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c8d20 0x7fd3c00ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.275+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8888005860 con 0x7f88b00c5420 2024-04-17T14:40:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.303+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4a28055190 con 0x7f4a3806bc90 2024-04-17T14:40:11.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.343+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4a280577f0 con 0x7f4a3806bc90 2024-04-17T14:40:11.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.363+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3fbc0c3070 con 0x7f3fd00ca2b0 2024-04-17T14:40:11.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:34790/0 (socket says 172.21.15.16:34790) 2024-04-17T14:40:11.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7fbac5e00640 1 -- 172.21.15.16:0/1559436270 learned_addr learned my addr 172.21.15.16:0/1559436270 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7f3fc6a00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 0x7f3fb006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7f3fcea00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 0x7f3fb006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.371+0000 7f3fcea00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 0x7f3fb006a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009650 tx=0x7f3fc0006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.379+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3fbc0f1f80 con 0x7f3fd00ca2b0 2024-04-17T14:40:11.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fbac5e00640 1 -- 172.21.15.16:0/1559436270 >> v2:172.21.15.67:3300/0 conn(0x7fbac006baa0 msgr2=0x7fbac0062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fbac5e00640 1 --2- 172.21.15.16:0/1559436270 >> v2:172.21.15.67:3300/0 conn(0x7fbac006baa0 0x7fbac0062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fbac5e00640 1 -- 172.21.15.16:0/1559436270 >> v1:172.21.15.67:6789/0 conn(0x7fbac0155150 legacy=0x7fbac006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:11.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fbac5e00640 1 -- 172.21.15.16:0/1559436270 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac015b0f0 con 0x7fbac0154d70 2024-04-17T14:40:11.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:34812/0 (socket says 172.21.15.16:34812) 2024-04-17T14:40:11.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.383+0000 7fd3bf400640 1 -- 172.21.15.16:0/660035961 learned_addr learned my addr 172.21.15.16:0/660035961 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.391+0000 7fd3bf400640 1 -- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3c0153050 msgr2=0x7fd3c0145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.391+0000 7fd3bf400640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3c0153050 0x7fd3c0145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.391+0000 7fd3bf400640 1 -- 172.21.15.16:0/660035961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c8d20 msgr2=0x7fd3c00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.391+0000 7fd3bf400640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c8d20 0x7fd3c00ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.391+0000 7fd3bf400640 1 -- 172.21.15.16:0/660035961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c01485d0 con 0x7fd3c00c3060 2024-04-17T14:40:11.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.399+0000 7fd3bf400640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b440 tx=0x7fd3b000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.399+0000 7fbac5e00640 1 --2- 172.21.15.16:0/1559436270 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009870 tx=0x7fbab401ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ed2893a65492b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.403+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0015020 con 0x7fd3c00c3060 2024-04-17T14:40:11.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.403+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c0148330 con 0x7fd3c00c3060 2024-04-17T14:40:11.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.403+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c0147da0 con 0x7fd3c00c3060 2024-04-17T14:40:11.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.403+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c01efa90 con 0x7fd3c00c3060 2024-04-17T14:40:11.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.407+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8001250 con 0x7fd79c0039c0 2024-04-17T14:40:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.407+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a8005270 con 0x7fd79c0039c0 2024-04-17T14:40:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.407+0000 7fd7b5e00640 1 -- 172.21.15.16:0/2505454436 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80054a0 con 0x7fd79c0039c0 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd79c0039c0 msgr2=0x7fd79c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/2505454436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd79c0039c0 0x7fd79c003dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001650 tx=0x7fd7a801c300 comp rx=0 tx=0).stop 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7b7200640 1 -- 172.21.15.16:0/2505454436 reap_dead start 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/2505454436 shutdown_connections 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/2505454436 >> 172.21.15.16:0/2505454436 conn(0x7fd7b8062850 msgr2=0x7fd7b806f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/2505454436 shutdown_connections 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/2505454436 wait complete. 2024-04-17T14:40:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3fbc0ca020 con 0x7f3fd00ca2b0 2024-04-17T14:40:11.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 Processor -- start 2024-04-17T14:40:11.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- start start 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c0039c0 0x7fd7b806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7b8158440 0x7fd7b806e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b80c36c0 con 0x7fd7b8158440 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b815b400 con 0x7fd7b815c030 2024-04-17T14:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.411+0000 7fd7bd400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b806ded0 con 0x7fd79c0039c0 2024-04-17T14:40:11.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.415+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b0011890 con 0x7fd3c00c3060 2024-04-17T14:40:11.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.415+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0011ca0 con 0x7fd3c00c3060 2024-04-17T14:40:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.415+0000 7fbac4a00640 1 -- 172.21.15.16:0/1559436270 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40b5070 con 0x7fbac0154d70 2024-04-17T14:40:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.415+0000 7fbac4a00640 1 -- 172.21.15.16:0/1559436270 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab40a89d0 con 0x7fbac0154d70 2024-04-17T14:40:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.415+0000 7fbac4a00640 1 -- 172.21.15.16:0/1559436270 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40a8da0 con 0x7fbac0154d70 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- 172.21.15.16:0/1559436270 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 msgr2=0x7fbac006cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- 172.21.15.16:0/1559436270 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009870 tx=0x7fbab401ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- 172.21.15.16:0/1559436270 shutdown_connections 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- 172.21.15.16:0/1559436270 >> v2:172.21.15.67:3300/0 conn(0x7fbac006baa0 0x7fbac0062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- 172.21.15.16:0/1559436270 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac006cbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- 172.21.15.16:0/1559436270 >> 172.21.15.16:0/1559436270 conn(0x7fbac00cd410 msgr2=0x7fbac00cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- 172.21.15.16:0/1559436270 shutdown_connections 2024-04-17T14:40:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- 172.21.15.16:0/1559436270 wait complete. 2024-04-17T14:40:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 Processor -- start 2024-04-17T14:40:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- start start 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac0155150 0x7fbac01f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbac015b990 con 0x7fbac0155150 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbac015b6b0 con 0x7fbac006baa0 2024-04-17T14:40:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.419+0000 7fbac8800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fbac0070600 con 0x7fbac0154d70 2024-04-17T14:40:11.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.447+0000 7fd7b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.455+0000 7fd7b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47426/0 (socket says 172.21.15.16:47426) 2024-04-17T14:40:11.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.455+0000 7fd7b7200640 1 -- 172.21.15.16:0/3967571852 learned_addr learned my addr 172.21.15.16:0/3967571852 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.467+0000 7fd7b7200640 1 -- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c0039c0 msgr2=0x7fd7b806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.467+0000 7fd7b7200640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c0039c0 0x7fd7b806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.467+0000 7fd7b7200640 1 -- 172.21.15.16:0/3967571852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7b8158440 msgr2=0x7fd7b806e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.467+0000 7fd7b7200640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7b8158440 0x7fd7b806e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.467+0000 7fd7b7200640 1 -- 172.21.15.16:0/3967571852 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b81f0c80 con 0x7fd7b815c030 2024-04-17T14:40:11.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.471+0000 7fd7b7200640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80c46b0 tx=0x7fd7b000ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.475+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47430/0 (socket says 172.21.15.16:47430) 2024-04-17T14:40:11.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fbac5e00640 1 -- 172.21.15.16:0/4132429165 learned_addr learned my addr 172.21.15.16:0/4132429165 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0017070 con 0x7fd7b815c030 2024-04-17T14:40:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b000aa70 con 0x7fd7b815c030 2024-04-17T14:40:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000ae60 con 0x7fd7b815c030 2024-04-17T14:40:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b81f0f40 con 0x7fd7b815c030 2024-04-17T14:40:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.483+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b81f1500 con 0x7fd7b815c030 2024-04-17T14:40:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.487+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b8076280 con 0x7fd7b815c030 2024-04-17T14:40:11.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.487+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ad401a070 con 0x7f8ae4070d90 2024-04-17T14:40:11.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.491+0000 7f8adbe00640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 0x7f8ac406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.491+0000 7f8ae3400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 0x7f8ac406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.491+0000 7f8ae3400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 0x7f8ac406a890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4151050 tx=0x7f8ad0006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.495+0000 7fbac5e00640 1 -- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 msgr2=0x7fbac00c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.495+0000 7fbac5e00640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.495+0000 7fbac5e00640 1 -- 172.21.15.16:0/4132429165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac0155150 msgr2=0x7fbac01f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.495+0000 7fbac5e00640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac0155150 0x7fbac01f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.495+0000 7fbac5e00640 1 -- 172.21.15.16:0/4132429165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac00cdfe0 con 0x7fbac006baa0 2024-04-17T14:40:11.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.503+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8ad40540f0 con 0x7f8ae4070d90 2024-04-17T14:40:11.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.503+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8ad4021020 con 0x7f8ae4070d90 2024-04-17T14:40:11.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88a6000640 1 -- 172.21.15.16:0/1176271703 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88980f3c30 con 0x7f88b00c5420 2024-04-17T14:40:11.506 INFO:teuthology.orchestra.run.smithi016.stdout:60129542157 2024-04-17T14:40:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 msgr2=0x7f888c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 0x7f888c06a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88b00cdbe0 tx=0x7f88a0009040 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 msgr2=0x7f88b00af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88980097f0 tx=0x7f889801ba90 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 shutdown_connections 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f888c0683d0 0x7f888c06a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.507+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88b0152ec0 0x7f88b00c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.511+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f88b00ca2b0 0x7f88b0151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.511+0000 7f88b4e00640 1 --2- 172.21.15.16:0/1176271703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b00c5420 0x7f88b00af890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.511+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 >> 172.21.15.16:0/1176271703 conn(0x7f88b0062850 msgr2=0x7f88b00c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.511+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 shutdown_connections 2024-04-17T14:40:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.511+0000 7f88b4e00640 1 -- 172.21.15.16:0/1176271703 wait complete. 2024-04-17T14:40:11.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.515+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c007c70 con 0x7fb084004120 2024-04-17T14:40:11.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.515+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c005b00 con 0x7fb084004120 2024-04-17T14:40:11.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.515+0000 7fb09ca00640 1 -- 172.21.15.16:0/1998918230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c007070 con 0x7fb084004120 2024-04-17T14:40:11.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 -- 172.21.15.16:0/1998918230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 msgr2=0x7fb084004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 --2- 172.21.15.16:0/1998918230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb084004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00c190 tx=0x7fb08c01f330 comp rx=0 tx=0).stop 2024-04-17T14:40:11.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09e800640 1 -- 172.21.15.16:0/1998918230 reap_dead start 2024-04-17T14:40:11.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 -- 172.21.15.16:0/1998918230 shutdown_connections 2024-04-17T14:40:11.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 -- 172.21.15.16:0/1998918230 >> 172.21.15.16:0/1998918230 conn(0x7fb0a00707d0 msgr2=0x7fb0a0070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 -- 172.21.15.16:0/1998918230 shutdown_connections 2024-04-17T14:40:11.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 -- 172.21.15.16:0/1998918230 wait complete. 2024-04-17T14:40:11.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.519+0000 7fb09f200640 1 Processor -- start 2024-04-17T14:40:11.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 -- start start 2024-04-17T14:40:11.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a0157e00 0x7fb0a0160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a014d4f0 0x7fb0a01476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a006baa0 con 0x7fb084004120 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0163220 con 0x7fb0a0157e00 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7fb09f200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0159610 con 0x7fb0a014d4f0 2024-04-17T14:40:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.523+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4a3814ee90 con 0x7f4a3806bc90 2024-04-17T14:40:11.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.531+0000 7fb09de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.531+0000 7fb09de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32828/0 (socket says 172.21.15.16:32828) 2024-04-17T14:40:11.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.531+0000 7fb09de00640 1 -- 172.21.15.16:0/3146214326 learned_addr learned my addr 172.21.15.16:0/3146214326 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:11.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.5 2024-04-17T14:40:11.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.539+0000 7fb09de00640 1 -- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a014d4f0 msgr2=0x7fb0a01476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.539+0000 7fb09de00640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a014d4f0 0x7fb0a01476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.539+0000 7fb09de00640 1 -- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a0157e00 msgr2=0x7fb0a0160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.539+0000 7fb09de00640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a0157e00 0x7fb0a0160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.539+0000 7fb09de00640 1 -- 172.21.15.16:0/3146214326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a0155380 con 0x7fb084004120 2024-04-17T14:40:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.591+0000 7fb09de00640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b4d0 tx=0x7fb09000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.603+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090014070 con 0x7fb084004120 2024-04-17T14:40:11.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.603+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb090010610 con 0x7fb084004120 2024-04-17T14:40:11.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.603+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900109e0 con 0x7fb084004120 2024-04-17T14:40:11.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.603+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a0155620 con 0x7fb084004120 2024-04-17T14:40:11.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.603+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a01f8200 con 0x7fb084004120 2024-04-17T14:40:11.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.607+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a0158240 con 0x7fb084004120 2024-04-17T14:40:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.639+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3fd00cb300 con 0x7f3fd00ca2b0 2024-04-17T14:40:11.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.643+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb090017070 con 0x7fb084004120 2024-04-17T14:40:11.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.643+0000 7fb096000640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 0x7fb08006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.643+0000 7fb09d400640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 0x7fb08006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.643+0000 7fb09d400640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 0x7fb08006a8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0ae000 tx=0x7fb0a015ef70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.647+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb0900546f0 con 0x7fb084004120 2024-04-17T14:40:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.719+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8ae40c7b50 con 0x7f8ae4070d90 2024-04-17T14:40:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.795+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3b0018020 con 0x7fd3c00c3060 2024-04-17T14:40:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.795+0000 7fd3b7400640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 0x7fd3a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.795+0000 7fd3bea00640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 0x7fd3a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.795+0000 7fd3bea00640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 0x7fd3a006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0b2000 tx=0x7fd3ac0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.803+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd3b0055010 con 0x7fd3c00c3060 2024-04-17T14:40:11.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.839+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd3b001f020 con 0x7fd3c00c3060 2024-04-17T14:40:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.843+0000 7f4a2e000640 1 -- 172.21.15.16:0/2892741340 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a280570f0 con 0x7f4a3806bc90 2024-04-17T14:40:11.842 INFO:teuthology.orchestra.run.smithi016.stdout:64424509454 2024-04-17T14:40:11.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.843+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 msgr2=0x7f4a1806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.843+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 0x7f4a1806a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4a380c6950 tx=0x7f4a24008040 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.843+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 msgr2=0x7f4a381f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.843+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e930 tx=0x7f4a2800edf0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 shutdown_connections 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4a18068400 0x7f4a1806a8c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a3806d5e0 0x7f4a380c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a3806cb20 0x7f4a381447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 --2- 172.21.15.16:0/2892741340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a3806bc90 0x7f4a381f4160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 >> 172.21.15.16:0/2892741340 conn(0x7f4a380c8b80 msgr2=0x7f4a3814f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 shutdown_connections 2024-04-17T14:40:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.847+0000 7f4a37200640 1 -- 172.21.15.16:0/2892741340 wait complete. 2024-04-17T14:40:11.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.855+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7b001a070 con 0x7fd7b815c030 2024-04-17T14:40:11.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.855+0000 7fd7aea00640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 0x7fd79406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:11.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.855+0000 7fd7b6800640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 0x7fd79406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:11.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.859+0000 7fd7b6800640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 0x7fd79406a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80aa000 tx=0x7fd7a8000fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.863+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd7b0054640 con 0x7fd7b815c030 2024-04-17T14:40:11.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.6 2024-04-17T14:40:11.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.899+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd7b0021020 con 0x7fd7b815c030 2024-04-17T14:40:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.907+0000 7fbac5e00640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab401c940 tx=0x7fbab401bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:11.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.915+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb090056d50 con 0x7fb084004120 2024-04-17T14:40:11.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.927+0000 7f8adbe00640 1 -- 172.21.15.16:0/2363442287 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ad4056750 con 0x7f8ae4070d90 2024-04-17T14:40:11.926 INFO:teuthology.orchestra.run.smithi016.stdout:64424509454 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 msgr2=0x7f8ac406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 0x7f8ac406a890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4151050 tx=0x7f8ad0006ca0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 msgr2=0x7f8ae4157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c370 tx=0x7f8ad400c830 comp rx=0 tx=0).stop 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 shutdown_connections 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f8ac40683d0 0x7f8ac406a890 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae41519c0 0x7f8ae41528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8ae40c8a80 0x7f8ae41f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 --2- 172.21.15.16:0/2363442287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae4070d90 0x7f8ae4157060 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:11.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 >> 172.21.15.16:0/2363442287 conn(0x7f8ae40728a0 msgr2=0x7f8ae4072c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:11.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 shutdown_connections 2024-04-17T14:40:11.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:11.931+0000 7f8ae9400640 1 -- 172.21.15.16:0/2363442287 wait complete. 2024-04-17T14:40:11.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.1 2024-04-17T14:40:12.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fc6a00640 1 -- 172.21.15.16:0/2919712012 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fbc018830 con 0x7f3fd00ca2b0 2024-04-17T14:40:12.017 INFO:teuthology.orchestra.run.smithi016.stdout:64424509453 2024-04-17T14:40:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 msgr2=0x7f3fb006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 0x7f3fb006a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009650 tx=0x7f3fc0006bb0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 msgr2=0x7f3fd01557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b3040 tx=0x7f3fbc01ba70 comp rx=0 tx=0).stop 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 shutdown_connections 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3fb00683d0 0x7f3fb006a890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fd0152ec0 0x7f3fd00c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fd00ca2b0 0x7f3fd01557c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 --2- 172.21.15.16:0/2919712012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3fd00c5420 0x7f3fd0152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 >> 172.21.15.16:0/2919712012 conn(0x7f3fd0062850 msgr2=0x7f3fd00cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.019+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40b5050 con 0x7fbac006baa0 2024-04-17T14:40:12.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab40bf070 con 0x7fbac006baa0 2024-04-17T14:40:12.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40b0d10 con 0x7fbac006baa0 2024-04-17T14:40:12.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01f4ea0 con 0x7fbac006baa0 2024-04-17T14:40:12.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 shutdown_connections 2024-04-17T14:40:12.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac0158d50 con 0x7fbac006baa0 2024-04-17T14:40:12.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd3c0076280 con 0x7fd3c00c3060 2024-04-17T14:40:12.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7f3fd5c00640 1 -- 172.21.15.16:0/2919712012 wait complete. 2024-04-17T14:40:12.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.023+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac0076280 con 0x7fbac006baa0 2024-04-17T14:40:12.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.027+0000 7fd3b7400640 1 -- 172.21.15.16:0/660035961 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3b000d040 con 0x7fd3c00c3060 2024-04-17T14:40:12.027 INFO:teuthology.orchestra.run.smithi016.stdout:64424509454 2024-04-17T14:40:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 msgr2=0x7fd3a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 0x7fd3a006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0b2000 tx=0x7fd3ac0aa070 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 msgr2=0x7fd3c0156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b440 tx=0x7fd3b000b900 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 shutdown_connections 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd3a0068380 0x7fd3a006a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3c0153050 0x7fd3c0145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3c00c8d20 0x7fd3c00ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 --2- 172.21.15.16:0/660035961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3c00c3060 0x7fd3c0156f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 >> 172.21.15.16:0/660035961 conn(0x7fd3c006ba30 msgr2=0x7fd3c014d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 shutdown_connections 2024-04-17T14:40:12.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.031+0000 7fd3c6600640 1 -- 172.21.15.16:0/660035961 wait complete. 2024-04-17T14:40:12.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.2 2024-04-17T14:40:12.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.0 2024-04-17T14:40:12.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.075+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd7b80c3c90 con 0x7fd7b815c030 2024-04-17T14:40:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.111+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb0a00761a0 con 0x7fb084004120 2024-04-17T14:40:12.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.115+0000 7fb096000640 1 -- 172.21.15.16:0/3146214326 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb090056650 con 0x7fb084004120 2024-04-17T14:40:12.115 INFO:teuthology.orchestra.run.smithi016.stdout:60129542157 2024-04-17T14:40:12.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 msgr2=0x7fb08006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 0x7fb08006a8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0ae000 tx=0x7fb0a015ef70 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 msgr2=0x7fb0a0158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b4d0 tx=0x7fb09000b990 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 shutdown_connections 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb080068400 0x7fb08006a8c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0a014d4f0 0x7fb0a01476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0a0157e00 0x7fb0a0160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 --2- 172.21.15.16:0/3146214326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb084004120 0x7fb0a0158510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 >> 172.21.15.16:0/3146214326 conn(0x7fb0a00707d0 msgr2=0x7fb0a0156030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 shutdown_connections 2024-04-17T14:40:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.119+0000 7fb09f200640 1 -- 172.21.15.16:0/3146214326 wait complete. 2024-04-17T14:40:12.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.7 2024-04-17T14:40:12.137 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.355+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbab40ba440 con 0x7fbac006baa0 2024-04-17T14:40:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.355+0000 7fbaba000640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 0x7fbaa406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.355+0000 7fbac5400640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 0x7fbaa406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.355+0000 7fbac5400640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 0x7fbaa406a8c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbac00c8e60 tx=0x7fbab0006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.367+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fbab40bbe00 con 0x7fbac006baa0 2024-04-17T14:40:12.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.399+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbab4018870 con 0x7fbac006baa0 2024-04-17T14:40:12.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.407+0000 7fd7aea00640 1 -- 172.21.15.16:0/3967571852 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7b0056ca0 con 0x7fd7b815c030 2024-04-17T14:40:12.407 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 msgr2=0x7fd79406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 0x7fd79406a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80aa000 tx=0x7fd7a8000fc0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 msgr2=0x7fd7b81f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80c46b0 tx=0x7fd7b000ccd0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 shutdown_connections 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd794068400 0x7fd79406a8c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b815c030 0x7fd7b81f3ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7b8158440 0x7fd7b806e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 --2- 172.21.15.16:0/3967571852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd79c0039c0 0x7fd7b806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 >> 172.21.15.16:0/3967571852 conn(0x7fd7b8062850 msgr2=0x7fd7b80ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 shutdown_connections 2024-04-17T14:40:12.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.411+0000 7fd7bd400640 1 -- 172.21.15.16:0/3967571852 wait complete. 2024-04-17T14:40:12.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.3 2024-04-17T14:40:12.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T14:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.575+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbac014ee00 con 0x7fbac006baa0 2024-04-17T14:40:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbaba000640 1 -- 172.21.15.16:0/4132429165 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbab40a89a0 con 0x7fbac006baa0 2024-04-17T14:40:12.676 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 msgr2=0x7fbaa406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 0x7fbaa406a8c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbac00c8e60 tx=0x7fbab0006ca0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 msgr2=0x7fbac00c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab401c940 tx=0x7fbab401bab0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 shutdown_connections 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbaa4068400 0x7fbaa406a8c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac0155150 0x7fbac01f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbac0154d70 0x7fbac00c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 --2- 172.21.15.16:0/4132429165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac006baa0 0x7fbac00c6e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 >> 172.21.15.16:0/4132429165 conn(0x7fbac00cd410 msgr2=0x7fbac00c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 shutdown_connections 2024-04-17T14:40:12.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.679+0000 7fbac8800640 1 -- 172.21.15.16:0/4132429165 wait complete. 2024-04-17T14:40:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 Processor -- start 2024-04-17T14:40:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 -- start start 2024-04-17T14:40:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f388c0c83b0 0x7f388c06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f388c06ba30 0x7f388c15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0c8930 con 0x7f388c155090 2024-04-17T14:40:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f388c155470 con 0x7f388c06ba30 2024-04-17T14:40:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3894400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f388c0c8bd0 con 0x7f388c0c83b0 2024-04-17T14:40:12.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.683+0000 7f3891000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f388c0c83b0 0x7f388c06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.687+0000 7f3891000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f388c0c83b0 0x7f388c06cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47444/0 (socket says 172.21.15.16:47444) 2024-04-17T14:40:12.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.687+0000 7f3891000640 1 -- 172.21.15.16:0/2113995548 learned_addr learned my addr 172.21.15.16:0/2113995548 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.687+0000 7f3892400640 1 --2- 172.21.15.16:0/2113995548 >> v2:172.21.15.16:3300/0 conn(0x7f388c06ba30 0x7f388c15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.691+0000 7f3891000640 1 -- 172.21.15.16:0/2113995548 >> v2:172.21.15.16:3300/0 conn(0x7f388c06ba30 msgr2=0x7f388c15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.691+0000 7f3891000640 1 --2- 172.21.15.16:0/2113995548 >> v2:172.21.15.16:3300/0 conn(0x7f388c06ba30 0x7f388c15e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.691+0000 7f3891000640 1 -- 172.21.15.16:0/2113995548 >> v1:172.21.15.16:6789/0 conn(0x7f388c155090 legacy=0x7f388c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.691+0000 7f3891000640 1 -- 172.21.15.16:0/2113995548 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0c8eb0 con 0x7f388c0c83b0 2024-04-17T14:40:12.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.699+0000 7f3891000640 1 --2- 172.21.15.16:0/2113995548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c06cd70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f388c0c5000 tx=0x7f387801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e8995b8fb64bc84 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:12.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.4 2024-04-17T14:40:12.699 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:12.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f388be00640 1 -- 172.21.15.16:0/2113995548 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780b5070 con 0x7f388c0c83b0 2024-04-17T14:40:12.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f388be00640 1 -- 172.21.15.16:0/2113995548 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38780a8a10 con 0x7f388c0c83b0 2024-04-17T14:40:12.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f388be00640 1 -- 172.21.15.16:0/2113995548 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780a8de0 con 0x7f388c0c83b0 2024-04-17T14:40:12.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 -- 172.21.15.16:0/2113995548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 msgr2=0x7f388c06cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 --2- 172.21.15.16:0/2113995548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c06cd70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f388c0c5000 tx=0x7f387801ed10 comp rx=0 tx=0).stop 2024-04-17T14:40:12.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 -- 172.21.15.16:0/2113995548 shutdown_connections 2024-04-17T14:40:12.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 --2- 172.21.15.16:0/2113995548 >> v2:172.21.15.16:3300/0 conn(0x7f388c06ba30 0x7f388c15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 --2- 172.21.15.16:0/2113995548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c06cd70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 -- 172.21.15.16:0/2113995548 >> 172.21.15.16:0/2113995548 conn(0x7f388c0cd480 msgr2=0x7f388c0cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:12.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 -- 172.21.15.16:0/2113995548 shutdown_connections 2024-04-17T14:40:12.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.707+0000 7f3894400640 1 -- 172.21.15.16:0/2113995548 wait complete. 2024-04-17T14:40:12.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 Processor -- start 2024-04-17T14:40:12.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 -- start start 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f388c155090 0x7f388c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f388c06c940 con 0x7f388c06ba30 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f388c06d400 con 0x7f388c0c83b0 2024-04-17T14:40:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3894400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f388c06cac0 con 0x7f388c155090 2024-04-17T14:40:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3891a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3891a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32848/0 (socket says 172.21.15.16:32848) 2024-04-17T14:40:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3891a00640 1 -- 172.21.15.16:0/3407909071 learned_addr learned my addr 172.21.15.16:0/3407909071 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.711+0000 7f3892400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f388c155090 0x7f388c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891000640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891a00640 1 -- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f388c155090 msgr2=0x7f388c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891a00640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f388c155090 0x7f388c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891a00640 1 -- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 msgr2=0x7f388c1f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891a00640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c1f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.715+0000 7f3891a00640 1 -- 172.21.15.16:0/3407909071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c15e000 con 0x7f388c06ba30 2024-04-17T14:40:12.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.719+0000 7f3891a00640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f388000c450 tx=0x7f388000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880016020 con 0x7f388c06ba30 2024-04-17T14:40:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38800052d0 con 0x7f388c06ba30 2024-04-17T14:40:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880007260 con 0x7f388c06ba30 2024-04-17T14:40:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c15d8e0 con 0x7f388c06ba30 2024-04-17T14:40:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c15cfb0 con 0x7f388c06ba30 2024-04-17T14:40:12.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.723+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c076280 con 0x7f388c06ba30 2024-04-17T14:40:12.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.743+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3880007400 con 0x7f388c06ba30 2024-04-17T14:40:12.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.743+0000 7f3889600640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 0x7f386c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:12.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.743+0000 7f3891000640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 0x7f386c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:12.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.743+0000 7f3891000640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 0x7f386c06a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38780b2000 tx=0x7f38780aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:12.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:12.743+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3880055100 con 0x7f388c06ba30 2024-04-17T14:40:12.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T14:40:12.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T14:40:13.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.003+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3880020020 con 0x7f388c06ba30 2024-04-17T14:40:13.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 Processor -- start 2024-04-17T14:40:13.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 -- start start 2024-04-17T14:40:13.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c5420 0x7f49ac15c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ac06e400 con 0x7f49ac152ec0 2024-04-17T14:40:13.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ac0c8ea0 con 0x7f49ac0ca2b0 2024-04-17T14:40:13.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.011+0000 7f49b3e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f49ac06e1d0 con 0x7f49ac0c5420 2024-04-17T14:40:13.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.015+0000 7f49b0a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c5420 0x7f49ac15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.015+0000 7f49b0a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49ac0c5420 0x7f49ac15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47470/0 (socket says 172.21.15.16:47470) 2024-04-17T14:40:13.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.015+0000 7f49b0a00640 1 -- 172.21.15.16:0/2379065873 learned_addr learned my addr 172.21.15.16:0/2379065873 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.023+0000 7f49b0a00640 1 -- 172.21.15.16:0/2379065873 >> v1:172.21.15.67:6789/0 conn(0x7f49ac0ca2b0 legacy=0x7f49ac1634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.023+0000 7f49b0a00640 1 -- 172.21.15.16:0/2379065873 >> v1:172.21.15.16:6789/0 conn(0x7f49ac152ec0 legacy=0x7f49ac0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.023+0000 7f49b0a00640 1 -- 172.21.15.16:0/2379065873 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac0c9160 con 0x7f49ac0c5420 2024-04-17T14:40:13.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.031+0000 7f49b0a00640 1 --2- 172.21.15.16:0/2379065873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0c5420 0x7f49ac15c130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4998009870 tx=0x7f499801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed896251f72b3c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49abe00640 1 -- 172.21.15.16:0/2379065873 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49980b5070 con 0x7f49ac0c5420 2024-04-17T14:40:13.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49abe00640 1 -- 172.21.15.16:0/2379065873 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49980a89d0 con 0x7f49ac0c5420 2024-04-17T14:40:13.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49abe00640 1 -- 172.21.15.16:0/2379065873 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49980a8da0 con 0x7f49ac0c5420 2024-04-17T14:40:13.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 -- 172.21.15.16:0/2379065873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0c5420 msgr2=0x7f49ac15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2379065873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0c5420 0x7f49ac15c130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4998009870 tx=0x7f499801ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 -- 172.21.15.16:0/2379065873 shutdown_connections 2024-04-17T14:40:13.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2379065873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0c5420 0x7f49ac15c130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 -- 172.21.15.16:0/2379065873 >> 172.21.15.16:0/2379065873 conn(0x7f49ac062850 msgr2=0x7f49ac06f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 -- 172.21.15.16:0/2379065873 shutdown_connections 2024-04-17T14:40:13.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.043+0000 7f49b3e00640 1 -- 172.21.15.16:0/2379065873 wait complete. 2024-04-17T14:40:13.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 Processor -- start 2024-04-17T14:40:13.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 -- start start 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c5420 0x7f49ac0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 0x7f49ac1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac158e90 con 0x7f49ac152ec0 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1532a0 con 0x7f49ac0ca2b0 2024-04-17T14:40:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b3e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f49ac159170 con 0x7f49ac0c5420 2024-04-17T14:40:13.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32852/0 (socket says 172.21.15.16:32852) 2024-04-17T14:40:13.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.047+0000 7f49b1e00640 1 -- 172.21.15.16:0/2056733292 learned_addr learned my addr 172.21.15.16:0/2056733292 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1400640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c5420 0x7f49ac0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b0a00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 0x7f49ac1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1e00640 1 -- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c5420 msgr2=0x7f49ac0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c5420 0x7f49ac0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1e00640 1 -- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 msgr2=0x7f49ac1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 0x7f49ac1f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b1e00640 1 -- 172.21.15.16:0/2056733292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac1f09a0 con 0x7f49ac152ec0 2024-04-17T14:40:13.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.051+0000 7f49b0a00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 0x7f49ac1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T14:40:13.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.055+0000 7f49b1e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c780 tx=0x7f49a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4004b70 con 0x7f49ac152ec0 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a4004d10 con 0x7f49ac152ec0 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a400aa90 con 0x7f49ac152ec0 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ac1f43d0 con 0x7f49ac152ec0 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ac1f0c40 con 0x7f49ac152ec0 2024-04-17T14:40:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.059+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ac076280 con 0x7f49ac152ec0 2024-04-17T14:40:13.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T14:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.099+0000 7f4e0ca00640 1 Processor -- start 2024-04-17T14:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.099+0000 7f4e0ca00640 1 -- start start 2024-04-17T14:40:13.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e0ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e08158430 0x7f4e0815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e0ca00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e0ca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08158810 con 0x7f4e080b0e00 2024-04-17T14:40:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e0ca00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4e08070470 con 0x7f4e08158430 2024-04-17T14:40:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e0ca00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0806bbd0 con 0x7f4e0806d760 2024-04-17T14:40:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:34876/0 (socket says 172.21.15.16:34876) 2024-04-17T14:40:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.103+0000 7f4e07e00640 1 -- 172.21.15.16:0/1289942580 learned_addr learned my addr 172.21.15.16:0/1289942580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.111+0000 7f4e07e00640 1 -- 172.21.15.16:0/1289942580 >> v2:172.21.15.16:3300/0 conn(0x7f4e08158430 msgr2=0x7f4e0815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.111+0000 7f4e07e00640 1 --2- 172.21.15.16:0/1289942580 >> v2:172.21.15.16:3300/0 conn(0x7f4e08158430 0x7f4e0815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.111+0000 7f4e07e00640 1 -- 172.21.15.16:0/1289942580 >> v1:172.21.15.16:6789/0 conn(0x7f4e080b0e00 legacy=0x7f4e080c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.111+0000 7f4e07e00640 1 -- 172.21.15.16:0/1289942580 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0806beb0 con 0x7f4e0806d760 2024-04-17T14:40:13.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.119+0000 7f4e07e00640 1 --2- 172.21.15.16:0/1289942580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e50 tx=0x7f4e0001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156c90f93f91ec40 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e06000640 1 -- 172.21.15.16:0/1289942580 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000a8bd0 con 0x7f4e0806d760 2024-04-17T14:40:13.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e06000640 1 -- 172.21.15.16:0/1289942580 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e000a8d70 con 0x7f4e0806d760 2024-04-17T14:40:13.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e06000640 1 -- 172.21.15.16:0/1289942580 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000b0610 con 0x7f4e0806d760 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 -- 172.21.15.16:0/1289942580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 msgr2=0x7f4e081655d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/1289942580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009e50 tx=0x7f4e0001f000 comp rx=0 tx=0).stop 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 -- 172.21.15.16:0/1289942580 shutdown_connections 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/1289942580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e0806d760 0x7f4e081655d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/1289942580 >> v2:172.21.15.16:3300/0 conn(0x7f4e08158430 0x7f4e0815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.127+0000 7f4e0ca00640 1 -- 172.21.15.16:0/1289942580 >> 172.21.15.16:0/1289942580 conn(0x7f4e08062c10 msgr2=0x7f4e0806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.131+0000 7f4e0ca00640 1 -- 172.21.15.16:0/1289942580 shutdown_connections 2024-04-17T14:40:13.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.131+0000 7f4e0ca00640 1 -- 172.21.15.16:0/1289942580 wait complete. 2024-04-17T14:40:13.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.131+0000 7f4e0ca00640 1 Processor -- start 2024-04-17T14:40:13.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.131+0000 7f4e0ca00640 1 -- start start 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e0806d760 0x7f4e08154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e08158430 0x7f4e080af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0815e780 con 0x7f4e0806d760 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0806c190 con 0x7f4e08158430 2024-04-17T14:40:13.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e0ca00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080cac00 con 0x7f4e080b0e00 2024-04-17T14:40:13.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e06a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e08158430 0x7f4e080af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e06a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:34880/0 (socket says 172.21.15.16:34880) 2024-04-17T14:40:13.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.135+0000 7f4e06a00640 1 -- 172.21.15.16:0/3140338110 learned_addr learned my addr 172.21.15.16:0/3140338110 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.147+0000 7f4e06a00640 1 -- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e08158430 msgr2=0x7f4e080af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.147+0000 7f4e06a00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e08158430 0x7f4e080af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.147+0000 7f4e06a00640 1 -- 172.21.15.16:0/3140338110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e0806d760 msgr2=0x7f4e08154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.147+0000 7f4e06a00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e0806d760 0x7f4e08154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.147+0000 7f4e06a00640 1 -- 172.21.15.16:0/3140338110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e081527f0 con 0x7f4e080b0e00 2024-04-17T14:40:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.151+0000 7f4e06a00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c4c0 tx=0x7f4df4001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.163+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4017070 con 0x7f4e080b0e00 2024-04-17T14:40:13.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.163+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4003600 con 0x7f4e080b0e00 2024-04-17T14:40:13.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.163+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df40039f0 con 0x7f4e080b0e00 2024-04-17T14:40:13.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.163+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e080b0290 con 0x7f4e080b0e00 2024-04-17T14:40:13.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.163+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e08154cc0 con 0x7f4e080b0e00 2024-04-17T14:40:13.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.167+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e080761a0 con 0x7f4e080b0e00 2024-04-17T14:40:13.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.183+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f388c15d600 con 0x7f388c06ba30 2024-04-17T14:40:13.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 Processor -- start 2024-04-17T14:40:13.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 -- start start 2024-04-17T14:40:13.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f636c070400 0x7f636c166800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c070910 con 0x7f636c0c9e60 2024-04-17T14:40:13.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c070bd0 con 0x7f636c0c9120 2024-04-17T14:40:13.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.207+0000 7f6373a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f636c070eb0 con 0x7f636c070400 2024-04-17T14:40:13.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.211+0000 7f636be00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f636c0c9120 0x7f636c06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:33148/0 (socket says 172.21.15.16:33148) 2024-04-17T14:40:13.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.211+0000 7f636be00640 1 -- 172.21.15.16:0/3256212113 learned_addr learned my addr 172.21.15.16:0/3256212113 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:13.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.219+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088135082 0 0) 0x7f636c070bd0 con 0x7f636c0c9120 2024-04-17T14:40:13.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.219+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6354003530 con 0x7f636c0c9120 2024-04-17T14:40:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2789200970 0 0) 0x7f6354003530 con 0x7f636c0c9120 2024-04-17T14:40:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 >> v2:172.21.15.16:3300/0 conn(0x7f636c070400 msgr2=0x7f636c166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 --2- 172.21.15.16:0/3256212113 >> v2:172.21.15.16:3300/0 conn(0x7f636c070400 0x7f636c166800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 >> v1:172.21.15.16:6789/0 conn(0x7f636c0c9e60 legacy=0x7f636c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c15b2a0 con 0x7f636c0c9120 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f6358001680 con 0x7f636c0c9120 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 >> v1:172.21.15.67:6789/0 conn(0x7f636c0c9120 legacy=0x7f636c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354003a10 0x7f6354003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6354004810 0x7f6354004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 0x7f635400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f636c070eb0 con 0x7f6354003a10 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f635400c230 con 0x7f63540052f0 2024-04-17T14:40:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.227+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f635400c430 con 0x7f6354004810 2024-04-17T14:40:13.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.239+0000 7f6371a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 0x7f635400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.243+0000 7f6371a00640 1 -- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6354004810 msgr2=0x7f6354004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.243+0000 7f6371a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6354004810 0x7f6354004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.243+0000 7f6371a00640 1 -- 172.21.15.16:0/3256212113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354003a10 msgr2=0x7f6354003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.243+0000 7f6371a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354003a10 0x7f6354003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.243+0000 7f6371a00640 1 -- 172.21.15.16:0/3256212113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6354003530 con 0x7f63540052f0 2024-04-17T14:40:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 Processor -- start 2024-04-17T14:40:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 -- start start 2024-04-17T14:40:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f6371a00640 1 -- 172.21.15.16:0/3256212113 reap_dead start 2024-04-17T14:40:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f44c80cb010 0x7f44c815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44c80cc3c0 0x7f44c80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c80cbf10 con 0x7f44c8155020 2024-04-17T14:40:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f44c80ccd30 con 0x7f44c80cb010 2024-04-17T14:40:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.247+0000 7f44ce000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f44c815b090 con 0x7f44c80cc3c0 2024-04-17T14:40:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.251+0000 7f44c7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44c80cc3c0 0x7f44c80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.255+0000 7f44c7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f44c80cc3c0 0x7f44c80cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47516/0 (socket says 172.21.15.16:47516) 2024-04-17T14:40:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.255+0000 7f44c7e00640 1 -- 172.21.15.16:0/161080217 learned_addr learned my addr 172.21.15.16:0/161080217 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.255+0000 7f6371a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 0x7f635400b9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f636c070840 tx=0x7f636401cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e274b839b006678b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.263+0000 7f44c7e00640 1 -- 172.21.15.16:0/161080217 >> v2:172.21.15.16:3300/0 conn(0x7f44c80cb010 msgr2=0x7f44c815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.263+0000 7f44c7e00640 1 --2- 172.21.15.16:0/161080217 >> v2:172.21.15.16:3300/0 conn(0x7f44c80cb010 0x7f44c815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.263+0000 7f44c7e00640 1 -- 172.21.15.16:0/161080217 >> v1:172.21.15.67:6789/0 conn(0x7f44c8155020 legacy=0x7f44c806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.263+0000 7f44c7e00640 1 -- 172.21.15.16:0/161080217 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c815b370 con 0x7f44c80cc3c0 2024-04-17T14:40:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.267+0000 7f44c7e00640 1 --2- 172.21.15.16:0/161080217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c80cc7f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44c806cf60 tx=0x7f44c001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81b0a519e18e1671 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364006e60 con 0x7f63540052f0 2024-04-17T14:40:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6364003b80 con 0x7f63540052f0 2024-04-17T14:40:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f636b400640 1 -- 172.21.15.16:0/3256212113 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63640a5940 con 0x7f63540052f0 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 -- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 msgr2=0x7f635400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 0x7f635400b9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f636c070840 tx=0x7f636401cc10 comp rx=0 tx=0).stop 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 -- 172.21.15.16:0/3256212113 shutdown_connections 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 --2- 172.21.15.16:0/3256212113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63540052f0 0x7f635400b9d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 -- 172.21.15.16:0/3256212113 >> 172.21.15.16:0/3256212113 conn(0x7f636c06dc40 msgr2=0x7f636c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 -- 172.21.15.16:0/3256212113 shutdown_connections 2024-04-17T14:40:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.287+0000 7f6373a00640 1 -- 172.21.15.16:0/3256212113 wait complete. 2024-04-17T14:40:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 Processor -- start 2024-04-17T14:40:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 -- start start 2024-04-17T14:40:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63540052f0 0x7f636c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f636c0c6eb0 0x7f636c1f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f636c15af50 con 0x7f63540052f0 2024-04-17T14:40:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f636c15b860 con 0x7f636c154630 2024-04-17T14:40:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f6373a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f636c15bd80 con 0x7f636c0c6eb0 2024-04-17T14:40:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44c6a00640 1 -- 172.21.15.16:0/161080217 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c00b4070 con 0x7f44c80cc3c0 2024-04-17T14:40:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44c6a00640 1 -- 172.21.15.16:0/161080217 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c00af400 con 0x7f44c80cc3c0 2024-04-17T14:40:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44c6a00640 1 -- 172.21.15.16:0/161080217 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c00af7d0 con 0x7f44c80cc3c0 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 -- 172.21.15.16:0/161080217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 msgr2=0x7f44c80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 --2- 172.21.15.16:0/161080217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c80cc7f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44c806cf60 tx=0x7f44c001f1e0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 -- 172.21.15.16:0/161080217 shutdown_connections 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 --2- 172.21.15.16:0/161080217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c80cc7f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 --2- 172.21.15.16:0/161080217 >> v2:172.21.15.16:3300/0 conn(0x7f44c80cb010 0x7f44c815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 -- 172.21.15.16:0/161080217 >> 172.21.15.16:0/161080217 conn(0x7f44c8062620 msgr2=0x7f44c80d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 -- 172.21.15.16:0/161080217 shutdown_connections 2024-04-17T14:40:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.291+0000 7f44ce000640 1 -- 172.21.15.16:0/161080217 wait complete. 2024-04-17T14:40:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 Processor -- start 2024-04-17T14:40:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 -- start start 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44c80cb010 0x7f44c81f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44c8155020 0x7f44c8153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80d1500 con 0x7f44c8155020 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f44c815b930 con 0x7f44c80cc3c0 2024-04-17T14:40:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f44ce000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f44c815ad60 con 0x7f44c80cb010 2024-04-17T14:40:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.295+0000 7f6371a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.299+0000 7f6371a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47522/0 (socket says 172.21.15.16:47522) 2024-04-17T14:40:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.299+0000 7f6371a00640 1 -- 172.21.15.16:0/3150522577 learned_addr learned my addr 172.21.15.16:0/3150522577 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.307+0000 7f6371a00640 1 -- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f636c0c6eb0 msgr2=0x7f636c1f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.307+0000 7f6371a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f636c0c6eb0 0x7f636c1f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.307+0000 7f6371a00640 1 -- 172.21.15.16:0/3150522577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63540052f0 msgr2=0x7f636c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.307+0000 7f6371a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63540052f0 0x7f636c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.307+0000 7f6371a00640 1 -- 172.21.15.16:0/3150522577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0b34c0 con 0x7f636c154630 2024-04-17T14:40:13.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.315+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.315+0000 7f6371a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f636401c680 tx=0x7f6354005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.315+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:47526/0 (socket says 172.21.15.16:47526) 2024-04-17T14:40:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.315+0000 7f44bfe00640 1 -- 172.21.15.16:0/3622925944 learned_addr learned my addr 172.21.15.16:0/3622925944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.331+0000 7f44bfe00640 1 -- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44c80cb010 msgr2=0x7f44c81f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.331+0000 7f44bfe00640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44c80cb010 0x7f44c81f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.331+0000 7f44bfe00640 1 -- 172.21.15.16:0/3622925944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44c8155020 msgr2=0x7f44c8153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.331+0000 7f44bfe00640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44c8155020 0x7f44c8153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.331+0000 7f44bfe00640 1 -- 172.21.15.16:0/3622925944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80c8100 con 0x7f44c80cc3c0 2024-04-17T14:40:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.335+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49a400ac30 con 0x7f49ac152ec0 2024-04-17T14:40:13.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.335+0000 7f49a9600640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 0x7f498c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.335+0000 7f49b1400640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 0x7f498c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.335+0000 7f49b1400640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 0x7f498c06a8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a0009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364006e60 con 0x7f636c154630 2024-04-17T14:40:13.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63640bd070 con 0x7f636c154630 2024-04-17T14:40:13.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364004260 con 0x7f636c154630 2024-04-17T14:40:13.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c157e80 con 0x7f636c154630 2024-04-17T14:40:13.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1f4300 con 0x7f636c154630 2024-04-17T14:40:13.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c076280 con 0x7f636c154630 2024-04-17T14:40:13.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.339+0000 7f44bfe00640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44b000b470 tx=0x7f44b000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.351+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f49a4055250 con 0x7f49ac152ec0 2024-04-17T14:40:13.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.351+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f49a4020070 con 0x7f49ac152ec0 2024-04-17T14:40:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.363+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0015020 con 0x7f44c80cc3c0 2024-04-17T14:40:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.363+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c815e410 con 0x7f44c80cc3c0 2024-04-17T14:40:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.363+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c815e150 con 0x7f44c80cc3c0 2024-04-17T14:40:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.363+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8076280 con 0x7f44c80cc3c0 2024-04-17T14:40:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.375+0000 7f3889600640 1 -- 172.21.15.16:0/3407909071 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3880005480 con 0x7f388c06ba30 2024-04-17T14:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout:60129542158 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 msgr2=0x7f386c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 0x7f386c06a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38780b2000 tx=0x7f38780aa070 comp rx=0 tx=0).stop 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 msgr2=0x7f388c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f388000c450 tx=0x7f388000c910 comp rx=0 tx=0).stop 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 shutdown_connections 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f386c0683d0 0x7f386c06a890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f388c155090 0x7f388c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f388c0c83b0 0x7f388c1f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 --2- 172.21.15.16:0/3407909071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f388c06ba30 0x7f388c15ca70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 >> 172.21.15.16:0/3407909071 conn(0x7f388c0cd480 msgr2=0x7f388c0c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 shutdown_connections 2024-04-17T14:40:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.379+0000 7f3894400640 1 -- 172.21.15.16:0/3407909071 wait complete. 2024-04-17T14:40:13.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.5 2024-04-17T14:40:13.400 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:13.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T14:40:13.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.523+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f49ac06ed80 con 0x7f49ac152ec0 2024-04-17T14:40:13.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49a9600640 1 -- 172.21.15.16:0/2056733292 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49a40578b0 con 0x7f49ac152ec0 2024-04-17T14:40:13.529 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 msgr2=0x7f498c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 0x7f498c06a8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a0009060 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 msgr2=0x7f49ac0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c780 tx=0x7f49a400cc40 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 shutdown_connections 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f498c068400 0x7f498c06a8c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49ac152ec0 0x7f49ac0c5800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49ac0ca2b0 0x7f49ac1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 --2- 172.21.15.16:0/2056733292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49ac0c5420 0x7f49ac0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 >> 172.21.15.16:0/2056733292 conn(0x7f49ac062850 msgr2=0x7f49ac071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 shutdown_connections 2024-04-17T14:40:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.531+0000 7f49b3e00640 1 -- 172.21.15.16:0/2056733292 wait complete. 2024-04-17T14:40:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.535+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4df401a070 con 0x7f4e080b0e00 2024-04-17T14:40:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.535+0000 7f4dff400640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 0x7f4de806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.539+0000 7f4e07400640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 0x7f4de806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.539+0000 7f4e07400640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 0x7f4de806a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009690 tx=0x7f4df8006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.543+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4df4054130 con 0x7f4e080b0e00 2024-04-17T14:40:13.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.6 2024-04-17T14:40:13.552 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:13.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.567+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4df4021020 con 0x7f4e080b0e00 2024-04-17T14:40:13.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 Processor -- start 2024-04-17T14:40:13.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 -- start start 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5854151db0 0x7f58540c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f585415be40 0x7f5854157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5854158610 con 0x7f5854158110 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f58540c8be0 con 0x7f5854151db0 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.591+0000 7f585ba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f5854071b30 con 0x7f585415be40 2024-04-17T14:40:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.595+0000 7f5859000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5854151db0 0x7f58540c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.595+0000 7f5859a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5854158110 0x7f58540c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43204/0 (socket says 172.21.15.16:43204) 2024-04-17T14:40:13.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.595+0000 7f5859a00640 1 -- 172.21.15.16:0/3670998580 learned_addr learned my addr 172.21.15.16:0/3670998580 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:13.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.599+0000 7f5859000640 1 -- 172.21.15.16:0/3670998580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f585415be40 msgr2=0x7f5854157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:13.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.599+0000 7f5859000640 1 --2- 172.21.15.16:0/3670998580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f585415be40 0x7f5854157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.599+0000 7f5859000640 1 -- 172.21.15.16:0/3670998580 >> v1:172.21.15.16:6789/0 conn(0x7f5854158110 legacy=0x7f58540c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.599+0000 7f5859000640 1 -- 172.21.15.16:0/3670998580 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58541588f0 con 0x7f5854151db0 2024-04-17T14:40:13.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.603+0000 7f5859000640 1 --2- 172.21.15.16:0/3670998580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854151db0 0x7f58540c86a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58440097f0 tx=0x7f584401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8152d48ac4b7a66 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.607+0000 7f5853e00640 1 -- 172.21.15.16:0/3670998580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440b5070 con 0x7f5854151db0 2024-04-17T14:40:13.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f5853e00640 1 -- 172.21.15.16:0/3670998580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440a8990 con 0x7f5854151db0 2024-04-17T14:40:13.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f5853e00640 1 -- 172.21.15.16:0/3670998580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440a8d60 con 0x7f5854151db0 2024-04-17T14:40:13.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- 172.21.15.16:0/3670998580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854151db0 msgr2=0x7f58540c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- 172.21.15.16:0/3670998580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854151db0 0x7f58540c86a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58440097f0 tx=0x7f584401ec90 comp rx=0 tx=0).stop 2024-04-17T14:40:13.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- 172.21.15.16:0/3670998580 shutdown_connections 2024-04-17T14:40:13.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- 172.21.15.16:0/3670998580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f585415be40 0x7f5854157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- 172.21.15.16:0/3670998580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854151db0 0x7f58540c86a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- 172.21.15.16:0/3670998580 >> 172.21.15.16:0/3670998580 conn(0x7f585406ba30 msgr2=0x7f585406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- 172.21.15.16:0/3670998580 shutdown_connections 2024-04-17T14:40:13.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- 172.21.15.16:0/3670998580 wait complete. 2024-04-17T14:40:13.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 Processor -- start 2024-04-17T14:40:13.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- start start 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5854151db0 0x7f58541577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f585415be40 0x7f5854148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f585415b920 con 0x7f5854158110 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f585415b640 con 0x7f585415be40 2024-04-17T14:40:13.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.611+0000 7f585ba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f58540c4080 con 0x7f5854151db0 2024-04-17T14:40:13.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.615+0000 7f584be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.615+0000 7f584be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32930/0 (socket says 172.21.15.16:32930) 2024-04-17T14:40:13.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.615+0000 7f584be00640 1 -- 172.21.15.16:0/1184538016 learned_addr learned my addr 172.21.15.16:0/1184538016 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:13.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.615+0000 7f5859000640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5854151db0 0x7f58541577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 -- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5854151db0 msgr2=0x7f58541577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5854151db0 0x7f58541577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 -- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f585415be40 msgr2=0x7f5854148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f585415be40 0x7f5854148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 -- 172.21.15.16:0/1184538016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58541f5380 con 0x7f5854158110 2024-04-17T14:40:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.619+0000 7f584be00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f583c00b550 tx=0x7f583c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c014070 con 0x7f5854158110 2024-04-17T14:40:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c010890 con 0x7f5854158110 2024-04-17T14:40:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c010c80 con 0x7f5854158110 2024-04-17T14:40:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58541f50a0 con 0x7f5854158110 2024-04-17T14:40:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540cc150 con 0x7f5854158110 2024-04-17T14:40:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.627+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5854076280 con 0x7f5854158110 2024-04-17T14:40:13.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.651+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f583c017070 con 0x7f5854158110 2024-04-17T14:40:13.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.651+0000 7f5851600640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 0x7f583006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.651+0000 7f5859000640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 0x7f583006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.655+0000 7f5859000640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 0x7f583006a8c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58440b2000 tx=0x7f5844008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.671+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b0011830 con 0x7f44c80cc3c0 2024-04-17T14:40:13.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.671+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0011c20 con 0x7f44c80cc3c0 2024-04-17T14:40:13.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.723+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63640b5030 con 0x7f636c154630 2024-04-17T14:40:13.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.723+0000 7f6368c00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 0x7f634c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:13.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.723+0000 7f6371000640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 0x7f634c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:13.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.727+0000 7f6371000640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 0x7f634c06a890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6360007fd0 tx=0x7f63600079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:13.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.731+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6364002020 con 0x7f636c154630 2024-04-17T14:40:13.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.767+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f636c0b34c0 con 0x7f636c154630 2024-04-17T14:40:13.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.779+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4e080b0460 con 0x7f4e080b0e00 2024-04-17T14:40:13.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4dff400640 1 -- 172.21.15.16:0/3140338110 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4df4056090 con 0x7f4e080b0e00 2024-04-17T14:40:13.794 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 msgr2=0x7f4de806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 0x7f4de806a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009690 tx=0x7f4df8006c00 comp rx=0 tx=0).stop 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 msgr2=0x7f4e0815d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c4c0 tx=0x7f4df4001e80 comp rx=0 tx=0).stop 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 shutdown_connections 2024-04-17T14:40:13.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4de80683d0 0x7f4de806a890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e08158430 0x7f4e080af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4e080b0e00 0x7f4e0815d400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 --2- 172.21.15.16:0/3140338110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e0806d760 0x7f4e08154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 >> 172.21.15.16:0/3140338110 conn(0x7f4e08062c10 msgr2=0x7f4e08070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 shutdown_connections 2024-04-17T14:40:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.795+0000 7f4e0ca00640 1 -- 172.21.15.16:0/3140338110 wait complete. 2024-04-17T14:40:13.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.1 2024-04-17T14:40:13.816 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:13.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.943+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f636c0759c0 con 0x7f636c154630 2024-04-17T14:40:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.943+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f583c054a30 con 0x7f5854158110 2024-04-17T14:40:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:13.943+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f583c056990 con 0x7f5854158110 2024-04-17T14:40:14.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.111+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f585414fd40 con 0x7f5854158110 2024-04-17T14:40:14.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.115+0000 7f5851600640 1 -- 172.21.15.16:0/1184538016 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f583c05be20 con 0x7f5854158110 2024-04-17T14:40:14.116 INFO:teuthology.orchestra.run.smithi016.stdout:64424509456 2024-04-17T14:40:14.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 msgr2=0x7f583006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 0x7f583006a8c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58440b2000 tx=0x7f5844008040 comp rx=0 tx=0).stop 2024-04-17T14:40:14.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 msgr2=0x7f5854147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f583c00b550 tx=0x7f583c00ba10 comp rx=0 tx=0).stop 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 shutdown_connections 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f5830068400 0x7f583006a8c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f585415be40 0x7f5854148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5854158110 0x7f5854147e00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 --2- 172.21.15.16:0/1184538016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5854151db0 0x7f58541577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 >> 172.21.15.16:0/1184538016 conn(0x7f585406ba30 msgr2=0x7f585414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 shutdown_connections 2024-04-17T14:40:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.119+0000 7f585ba00640 1 -- 172.21.15.16:0/1184538016 wait complete. 2024-04-17T14:40:14.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.123+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44b0018020 con 0x7f44c80cc3c0 2024-04-17T14:40:14.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.123+0000 7f44bf400640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 0x7f44a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.123+0000 7f44c7400640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 0x7f44a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.127+0000 7f44c7400640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 0x7f44a406a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f70 tx=0x7f44b80079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:14.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f44b0054d30 con 0x7f44c80cc3c0 2024-04-17T14:40:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f6368c00640 1 -- 172.21.15.16:0/3150522577 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63640b3040 con 0x7f636c154630 2024-04-17T14:40:14.134 INFO:teuthology.orchestra.run.smithi016.stdout:64424509454 2024-04-17T14:40:14.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 msgr2=0x7f634c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 0x7f634c06a890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6360007fd0 tx=0x7f63600079a0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 msgr2=0x7f636c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.135+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f636401c680 tx=0x7f6354005840 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 shutdown_connections 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f634c0683d0 0x7f634c06a890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f636c154630 0x7f636c154ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f636c0c6eb0 0x7f636c1f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 --2- 172.21.15.16:0/3150522577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63540052f0 0x7f636c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 >> 172.21.15.16:0/3150522577 conn(0x7f636c06dc40 msgr2=0x7f636c158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 shutdown_connections 2024-04-17T14:40:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.139+0000 7f6373a00640 1 -- 172.21.15.16:0/3150522577 wait complete. 2024-04-17T14:40:14.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.3 2024-04-17T14:40:14.138 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:14.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.2 2024-04-17T14:40:14.156 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:14.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.159+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f44b001f020 con 0x7f44c80cc3c0 2024-04-17T14:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.331+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f44c80c61c0 con 0x7f44c80cc3c0 2024-04-17T14:40:14.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44bf400640 1 -- 172.21.15.16:0/3622925944 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44c80c61c0 con 0x7f44c80cc3c0 2024-04-17T14:40:14.337 INFO:teuthology.orchestra.run.smithi016.stdout:64424509455 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 msgr2=0x7f44a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 0x7f44a406a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f70 tx=0x7f44b80079e0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 msgr2=0x7f44c815bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44b000b470 tx=0x7f44b000b930 comp rx=0 tx=0).stop 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 shutdown_connections 2024-04-17T14:40:14.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f44a40683b0 0x7f44a406a870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44c8155020 0x7f44c8153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44c80cc3c0 0x7f44c815bec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 --2- 172.21.15.16:0/3622925944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44c80cb010 0x7f44c81f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 >> 172.21.15.16:0/3622925944 conn(0x7f44c8062620 msgr2=0x7f44c815e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 shutdown_connections 2024-04-17T14:40:14.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.339+0000 7f44ce000640 1 -- 172.21.15.16:0/3622925944 wait complete. 2024-04-17T14:40:14.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.0 2024-04-17T14:40:14.359 DEBUG:teuthology.parallel:result is None 2024-04-17T14:40:14.359 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T14:40:14.360 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T14:40:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 Processor -- start 2024-04-17T14:40:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 -- start start 2024-04-17T14:40:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0fc0c9a70 0x7fa0fc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0fc15eb80 con 0x7fa0fc0c4200 2024-04-17T14:40:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0fc15ee60 con 0x7fa0fc0c9690 2024-04-17T14:40:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa102600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc15aed0 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa0f2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0fc0c9a70 0x7fa0fc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa0f2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0fc0c9a70 0x7fa0fc15e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32940/0 (socket says 172.21.15.16:32940) 2024-04-17T14:40:14.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.543+0000 7fa0f2a00640 1 -- 172.21.15.16:0/234447335 learned_addr learned my addr 172.21.15.16:0/234447335 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.547+0000 7fa0f2a00640 1 -- 172.21.15.16:0/234447335 >> v1:172.21.15.67:6789/0 conn(0x7fa0fc0c9690 legacy=0x7fa0fc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.547+0000 7fa0f2a00640 1 -- 172.21.15.16:0/234447335 >> v1:172.21.15.16:6789/0 conn(0x7fa0fc0c4200 legacy=0x7fa0fc165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.547+0000 7fa0f2a00640 1 -- 172.21.15.16:0/234447335 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc15f140 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.551+0000 7fa0f2a00640 1 --2- 172.21.15.16:0/234447335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc15e440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009870 tx=0x7fa0ec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78eb4930da78ff71 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:14.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa0faa00640 1 -- 172.21.15.16:0/234447335 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0ab650 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa0faa00640 1 -- 172.21.15.16:0/234447335 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0b0070 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa0faa00640 1 -- 172.21.15.16:0/234447335 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0aba10 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 -- 172.21.15.16:0/234447335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c9a70 msgr2=0x7fa0fc15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 --2- 172.21.15.16:0/234447335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc15e440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009870 tx=0x7fa0ec01c560 comp rx=0 tx=0).stop 2024-04-17T14:40:14.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 -- 172.21.15.16:0/234447335 shutdown_connections 2024-04-17T14:40:14.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 --2- 172.21.15.16:0/234447335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc15e440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 -- 172.21.15.16:0/234447335 >> 172.21.15.16:0/234447335 conn(0x7fa0fc062850 msgr2=0x7fa0fc06f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:14.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.555+0000 7fa102600640 1 -- 172.21.15.16:0/234447335 shutdown_connections 2024-04-17T14:40:14.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 -- 172.21.15.16:0/234447335 wait complete. 2024-04-17T14:40:14.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 Processor -- start 2024-04-17T14:40:14.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 -- start start 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0fc0c9690 0x7fa0fc1f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0c36c0 con 0x7fa0fc0c4200 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc15b920 con 0x7fa0fc0c9a70 2024-04-17T14:40:14.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa102600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc1f7b10 con 0x7fa0fc0c9690 2024-04-17T14:40:14.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa0fb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa0fb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32944/0 (socket says 172.21.15.16:32944) 2024-04-17T14:40:14.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.559+0000 7fa0fb400640 1 -- 172.21.15.16:0/596082840 learned_addr learned my addr 172.21.15.16:0/596082840 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:14.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fbe00640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0f2a00640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0fc0c9690 0x7fa0fc1f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fb400640 1 -- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0fc0c9690 msgr2=0x7fa0fc1f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fb400640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0fc0c9690 0x7fa0fc1f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fb400640 1 -- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0c9a70 msgr2=0x7fa0fc1f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fb400640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc1f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.563+0000 7fa0fb400640 1 -- 172.21.15.16:0/596082840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc1f7df0 con 0x7fa0fc0c4200 2024-04-17T14:40:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.567+0000 7fa0fb400640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400c450 tx=0x7fa0e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4016020 con 0x7fa0fc0c4200 2024-04-17T14:40:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e40052d0 con 0x7fa0fc0c4200 2024-04-17T14:40:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4007260 con 0x7fa0fc0c4200 2024-04-17T14:40:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc1f80d0 con 0x7fa0fc0c4200 2024-04-17T14:40:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc158350 con 0x7fa0fc0c4200 2024-04-17T14:40:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.571+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0fc076280 con 0x7fa0fc0c4200 2024-04-17T14:40:14.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.591+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0e4007400 con 0x7fa0fc0c4200 2024-04-17T14:40:14.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.595+0000 7fa0f3e00640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 0x7fa0d806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:14.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.595+0000 7fa0f2a00640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 0x7fa0d806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:14.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.595+0000 7fa0f2a00640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 0x7fa0d806a8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0af000 tx=0x7fa0ec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.851+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa0e4055070 con 0x7fa0fc0c4200 2024-04-17T14:40:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:14.851+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa0e4020020 con 0x7fa0fc0c4200 2024-04-17T14:40:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.015+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0fc0c3c90 con 0x7fa0d8068400 2024-04-17T14:40:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.031+0000 7fa0f3e00640 1 -- 172.21.15.16:0/596082840 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251823 (secure 0 0 0) 0x7fa0fc0c3c90 con 0x7fa0d8068400 2024-04-17T14:40:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:15.036 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 msgr2=0x7fa0d806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 0x7fa0d806a8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0af000 tx=0x7fa0ec0a7000 comp rx=0 tx=0).stop 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 msgr2=0x7fa0fc157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400c450 tx=0x7fa0e400c910 comp rx=0 tx=0).stop 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 shutdown_connections 2024-04-17T14:40:15.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0d8068400 0x7fa0d806a8c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0fc0c9a70 0x7fa0fc1f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0fc0c9690 0x7fa0fc1f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 --2- 172.21.15.16:0/596082840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0fc0c4200 0x7fa0fc157e10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 >> 172.21.15.16:0/596082840 conn(0x7fa0fc062850 msgr2=0x7fa0fc15c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 shutdown_connections 2024-04-17T14:40:15.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.035+0000 7fa102600640 1 -- 172.21.15.16:0/596082840 wait complete. 2024-04-17T14:40:15.055 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-17T14:40:15.006030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236040,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738680,"statfs":{"total":773094113280,"available":772852408320,"internally_reserved":0,"allocated":3317760,"data_stored":1941236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003856"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449636+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T14:40:10.449636+0000","last_peered":"2024-04-17T14:40:10.449636+0000","last_clean":"2024-04-17T14:40:10.449636+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T14:40:10.449636+0000","last_undegraded":"2024-04-17T14:40:10.449636+0000","last_fullsized":"2024-04-17T14:40:10.449636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818783+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T14:40:09.818783+0000","last_peered":"2024-04-17T14:40:09.818783+0000","last_clean":"2024-04-17T14:40:09.818783+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T14:40:09.818783+0000","last_undegraded":"2024-04-17T14:40:09.818783+0000","last_fullsized":"2024-04-17T14:40:09.818783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818580+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T14:40:09.818580+0000","last_peered":"2024-04-17T14:40:09.818580+0000","last_clean":"2024-04-17T14:40:09.818580+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T14:40:09.818580+0000","last_undegraded":"2024-04-17T14:40:09.818580+0000","last_fullsized":"2024-04-17T14:40:09.818580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451428+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T14:40:10.451428+0000","last_peered":"2024-04-17T14:40:10.451428+0000","last_clean":"2024-04-17T14:40:10.451428+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T14:40:10.451428+0000","last_undegraded":"2024-04-17T14:40:10.451428+0000","last_fullsized":"2024-04-17T14:40:10.451428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449463+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T14:40:10.449463+0000","last_peered":"2024-04-17T14:40:10.449463+0000","last_clean":"2024-04-17T14:40:10.449463+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T14:40:10.449463+0000","last_undegraded":"2024-04-17T14:40:10.449463+0000","last_fullsized":"2024-04-17T14:40:10.449463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450151+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T14:40:10.450151+0000","last_peered":"2024-04-17T14:40:10.450151+0000","last_clean":"2024-04-17T14:40:10.450151+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T14:40:10.450151+0000","last_undegraded":"2024-04-17T14:40:10.450151+0000","last_fullsized":"2024-04-17T14:40:10.450151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449037+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T14:40:10.449037+0000","last_peered":"2024-04-17T14:40:10.449037+0000","last_clean":"2024-04-17T14:40:10.449037+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T14:40:10.449037+0000","last_undegraded":"2024-04-17T14:40:10.449037+0000","last_fullsized":"2024-04-17T14:40:10.449037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818266+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T14:40:09.818266+0000","last_peered":"2024-04-17T14:40:09.818266+0000","last_clean":"2024-04-17T14:40:09.818266+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T14:40:09.818266+0000","last_undegraded":"2024-04-17T14:40:09.818266+0000","last_fullsized":"2024-04-17T14:40:09.818266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450788+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T14:40:10.450788+0000","last_peered":"2024-04-17T14:40:10.450788+0000","last_clean":"2024-04-17T14:40:10.450788+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T14:40:10.450788+0000","last_undegraded":"2024-04-17T14:40:10.450788+0000","last_fullsized":"2024-04-17T14:40:10.450788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449498+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T14:40:10.449498+0000","last_peered":"2024-04-17T14:40:10.449498+0000","last_clean":"2024-04-17T14:40:10.449498+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T14:40:10.449498+0000","last_undegraded":"2024-04-17T14:40:10.449498+0000","last_fullsized":"2024-04-17T14:40:10.449498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449333+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T14:40:10.449333+0000","last_peered":"2024-04-17T14:40:10.449333+0000","last_clean":"2024-04-17T14:40:10.449333+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T14:40:10.449333+0000","last_undegraded":"2024-04-17T14:40:10.449333+0000","last_fullsized":"2024-04-17T14:40:10.449333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449382+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T14:40:10.449382+0000","last_peered":"2024-04-17T14:40:10.449382+0000","last_clean":"2024-04-17T14:40:10.449382+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T14:40:10.449382+0000","last_undegraded":"2024-04-17T14:40:10.449382+0000","last_fullsized":"2024-04-17T14:40:10.449382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853599+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T14:40:09.853599+0000","last_peered":"2024-04-17T14:40:09.853599+0000","last_clean":"2024-04-17T14:40:09.853599+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T14:40:09.853599+0000","last_undegraded":"2024-04-17T14:40:09.853599+0000","last_fullsized":"2024-04-17T14:40:09.853599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853086+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T14:40:09.853086+0000","last_peered":"2024-04-17T14:40:09.853086+0000","last_clean":"2024-04-17T14:40:09.853086+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T14:40:09.853086+0000","last_undegraded":"2024-04-17T14:40:09.853086+0000","last_fullsized":"2024-04-17T14:40:09.853086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817655+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T14:40:09.817655+0000","last_peered":"2024-04-17T14:40:09.817655+0000","last_clean":"2024-04-17T14:40:09.817655+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T14:40:09.817655+0000","last_undegraded":"2024-04-17T14:40:09.817655+0000","last_fullsized":"2024-04-17T14:40:09.817655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448495+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T14:40:10.448495+0000","last_peered":"2024-04-17T14:40:10.448495+0000","last_clean":"2024-04-17T14:40:10.448495+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T14:40:10.448495+0000","last_undegraded":"2024-04-17T14:40:10.448495+0000","last_fullsized":"2024-04-17T14:40:10.448495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450539+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T14:40:10.450539+0000","last_peered":"2024-04-17T14:40:10.450539+0000","last_clean":"2024-04-17T14:40:10.450539+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T14:40:10.450539+0000","last_undegraded":"2024-04-17T14:40:10.450539+0000","last_fullsized":"2024-04-17T14:40:10.450539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868835+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T14:40:09.868835+0000","last_peered":"2024-04-17T14:40:09.868835+0000","last_clean":"2024-04-17T14:40:09.868835+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T14:40:09.868835+0000","last_undegraded":"2024-04-17T14:40:09.868835+0000","last_fullsized":"2024-04-17T14:40:09.868835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450076+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T14:40:10.450076+0000","last_peered":"2024-04-17T14:40:10.450076+0000","last_clean":"2024-04-17T14:40:10.450076+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T14:40:10.450076+0000","last_undegraded":"2024-04-17T14:40:10.450076+0000","last_fullsized":"2024-04-17T14:40:10.450076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449491+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T14:40:10.449491+0000","last_peered":"2024-04-17T14:40:10.449491+0000","last_clean":"2024-04-17T14:40:10.449491+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T14:40:10.449491+0000","last_undegraded":"2024-04-17T14:40:10.449491+0000","last_fullsized":"2024-04-17T14:40:10.449491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861763+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T14:40:09.861763+0000","last_peered":"2024-04-17T14:40:09.861763+0000","last_clean":"2024-04-17T14:40:09.861763+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T14:40:09.861763+0000","last_undegraded":"2024-04-17T14:40:09.861763+0000","last_fullsized":"2024-04-17T14:40:09.861763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449653+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T14:40:10.449653+0000","last_peered":"2024-04-17T14:40:10.449653+0000","last_clean":"2024-04-17T14:40:10.449653+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T14:40:10.449653+0000","last_undegraded":"2024-04-17T14:40:10.449653+0000","last_fullsized":"2024-04-17T14:40:10.449653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817982+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T14:40:09.817982+0000","last_peered":"2024-04-17T14:40:09.817982+0000","last_clean":"2024-04-17T14:40:09.817982+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T14:40:09.817982+0000","last_undegraded":"2024-04-17T14:40:09.817982+0000","last_fullsized":"2024-04-17T14:40:09.817982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448603+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T14:40:10.448603+0000","last_peered":"2024-04-17T14:40:10.448603+0000","last_clean":"2024-04-17T14:40:10.448603+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T14:40:10.448603+0000","last_undegraded":"2024-04-17T14:40:10.448603+0000","last_fullsized":"2024-04-17T14:40:10.448603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818852+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T14:40:09.818852+0000","last_peered":"2024-04-17T14:40:09.818852+0000","last_clean":"2024-04-17T14:40:09.818852+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T14:40:09.818852+0000","last_undegraded":"2024-04-17T14:40:09.818852+0000","last_fullsized":"2024-04-17T14:40:09.818852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451764+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T14:40:10.451764+0000","last_peered":"2024-04-17T14:40:10.451764+0000","last_clean":"2024-04-17T14:40:10.451764+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T14:40:10.451764+0000","last_undegraded":"2024-04-17T14:40:10.451764+0000","last_fullsized":"2024-04-17T14:40:10.451764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.854268+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T14:40:09.854268+0000","last_peered":"2024-04-17T14:40:09.854268+0000","last_clean":"2024-04-17T14:40:09.854268+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T14:40:09.854268+0000","last_undegraded":"2024-04-17T14:40:09.854268+0000","last_fullsized":"2024-04-17T14:40:09.854268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853751+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T14:40:09.853751+0000","last_peered":"2024-04-17T14:40:09.853751+0000","last_clean":"2024-04-17T14:40:09.853751+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T14:40:09.853751+0000","last_undegraded":"2024-04-17T14:40:09.853751+0000","last_fullsized":"2024-04-17T14:40:09.853751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818000+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T14:40:09.818000+0000","last_peered":"2024-04-17T14:40:09.818000+0000","last_clean":"2024-04-17T14:40:09.818000+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T14:40:09.818000+0000","last_undegraded":"2024-04-17T14:40:09.818000+0000","last_fullsized":"2024-04-17T14:40:09.818000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448902+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T14:40:10.448902+0000","last_peered":"2024-04-17T14:40:10.448902+0000","last_clean":"2024-04-17T14:40:10.448902+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T14:40:10.448902+0000","last_undegraded":"2024-04-17T14:40:10.448902+0000","last_fullsized":"2024-04-17T14:40:10.448902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.867900+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T14:40:09.867900+0000","last_peered":"2024-04-17T14:40:09.867900+0000","last_clean":"2024-04-17T14:40:09.867900+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T14:40:09.867900+0000","last_undegraded":"2024-04-17T14:40:09.867900+0000","last_fullsized":"2024-04-17T14:40:09.867900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449905+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T14:40:10.449905+0000","last_peered":"2024-04-17T14:40:10.449905+0000","last_clean":"2024-04-17T14:40:10.449905+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T14:40:10.449905+0000","last_undegraded":"2024-04-17T14:40:10.449905+0000","last_fullsized":"2024-04-17T14:40:10.449905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449749+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T14:40:10.449749+0000","last_peered":"2024-04-17T14:40:10.449749+0000","last_clean":"2024-04-17T14:40:10.449749+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T14:40:10.449749+0000","last_undegraded":"2024-04-17T14:40:10.449749+0000","last_fullsized":"2024-04-17T14:40:10.449749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818488+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T14:40:09.818488+0000","last_peered":"2024-04-17T14:40:09.818488+0000","last_clean":"2024-04-17T14:40:09.818488+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T14:40:09.818488+0000","last_undegraded":"2024-04-17T14:40:09.818488+0000","last_fullsized":"2024-04-17T14:40:09.818488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862316+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T14:40:09.862316+0000","last_peered":"2024-04-17T14:40:09.862316+0000","last_clean":"2024-04-17T14:40:09.862316+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T14:40:09.862316+0000","last_undegraded":"2024-04-17T14:40:09.862316+0000","last_fullsized":"2024-04-17T14:40:09.862316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449071+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T14:40:10.449071+0000","last_peered":"2024-04-17T14:40:10.449071+0000","last_clean":"2024-04-17T14:40:10.449071+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T14:40:10.449071+0000","last_undegraded":"2024-04-17T14:40:10.449071+0000","last_fullsized":"2024-04-17T14:40:10.449071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853117+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T14:40:09.853117+0000","last_peered":"2024-04-17T14:40:09.853117+0000","last_clean":"2024-04-17T14:40:09.853117+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T14:40:09.853117+0000","last_undegraded":"2024-04-17T14:40:09.853117+0000","last_fullsized":"2024-04-17T14:40:09.853117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818152+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T14:40:09.818152+0000","last_peered":"2024-04-17T14:40:09.818152+0000","last_clean":"2024-04-17T14:40:09.818152+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T14:40:09.818152+0000","last_undegraded":"2024-04-17T14:40:09.818152+0000","last_fullsized":"2024-04-17T14:40:09.818152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448694+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T14:40:10.448694+0000","last_peered":"2024-04-17T14:40:10.448694+0000","last_clean":"2024-04-17T14:40:10.448694+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T14:40:10.448694+0000","last_undegraded":"2024-04-17T14:40:10.448694+0000","last_fullsized":"2024-04-17T14:40:10.448694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861442+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T14:40:09.861442+0000","last_peered":"2024-04-17T14:40:09.861442+0000","last_clean":"2024-04-17T14:40:09.861442+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T14:40:09.861442+0000","last_undegraded":"2024-04-17T14:40:09.861442+0000","last_fullsized":"2024-04-17T14:40:09.861442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450978+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T14:40:10.450978+0000","last_peered":"2024-04-17T14:40:10.450978+0000","last_clean":"2024-04-17T14:40:10.450978+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T14:40:10.450978+0000","last_undegraded":"2024-04-17T14:40:10.450978+0000","last_fullsized":"2024-04-17T14:40:10.450978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451846+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T14:40:10.451846+0000","last_peered":"2024-04-17T14:40:10.451846+0000","last_clean":"2024-04-17T14:40:10.451846+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T14:40:10.451846+0000","last_undegraded":"2024-04-17T14:40:10.451846+0000","last_fullsized":"2024-04-17T14:40:10.451846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449719+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T14:40:10.449719+0000","last_peered":"2024-04-17T14:40:10.449719+0000","last_clean":"2024-04-17T14:40:10.449719+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T14:40:10.449719+0000","last_undegraded":"2024-04-17T14:40:10.449719+0000","last_fullsized":"2024-04-17T14:40:10.449719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819125+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T14:40:09.819125+0000","last_peered":"2024-04-17T14:40:09.819125+0000","last_clean":"2024-04-17T14:40:09.819125+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T14:40:09.819125+0000","last_undegraded":"2024-04-17T14:40:09.819125+0000","last_fullsized":"2024-04-17T14:40:09.819125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868780+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T14:40:09.868780+0000","last_peered":"2024-04-17T14:40:09.868780+0000","last_clean":"2024-04-17T14:40:09.868780+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T14:40:09.868780+0000","last_undegraded":"2024-04-17T14:40:09.868780+0000","last_fullsized":"2024-04-17T14:40:09.868780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449451+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T14:40:10.449451+0000","last_peered":"2024-04-17T14:40:10.449451+0000","last_clean":"2024-04-17T14:40:10.449451+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T14:40:10.449451+0000","last_undegraded":"2024-04-17T14:40:10.449451+0000","last_fullsized":"2024-04-17T14:40:10.449451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451526+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T14:40:10.451526+0000","last_peered":"2024-04-17T14:40:10.451526+0000","last_clean":"2024-04-17T14:40:10.451526+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T14:40:10.451526+0000","last_undegraded":"2024-04-17T14:40:10.451526+0000","last_fullsized":"2024-04-17T14:40:10.451526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449428+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T14:40:10.449428+0000","last_peered":"2024-04-17T14:40:10.449428+0000","last_clean":"2024-04-17T14:40:10.449428+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T14:40:10.449428+0000","last_undegraded":"2024-04-17T14:40:10.449428+0000","last_fullsized":"2024-04-17T14:40:10.449428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868746+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T14:40:09.868746+0000","last_peered":"2024-04-17T14:40:09.868746+0000","last_clean":"2024-04-17T14:40:09.868746+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T14:40:09.868746+0000","last_undegraded":"2024-04-17T14:40:09.868746+0000","last_fullsized":"2024-04-17T14:40:09.868746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853367+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T14:40:09.853367+0000","last_peered":"2024-04-17T14:40:09.853367+0000","last_clean":"2024-04-17T14:40:09.853367+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T14:40:09.853367+0000","last_undegraded":"2024-04-17T14:40:09.853367+0000","last_fullsized":"2024-04-17T14:40:09.853367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449163+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T14:40:10.449163+0000","last_peered":"2024-04-17T14:40:10.449163+0000","last_clean":"2024-04-17T14:40:10.449163+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T14:40:10.449163+0000","last_undegraded":"2024-04-17T14:40:10.449163+0000","last_fullsized":"2024-04-17T14:40:10.449163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449380+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T14:40:10.449380+0000","last_peered":"2024-04-17T14:40:10.449380+0000","last_clean":"2024-04-17T14:40:10.449380+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T14:40:10.449380+0000","last_undegraded":"2024-04-17T14:40:10.449380+0000","last_fullsized":"2024-04-17T14:40:10.449380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449090+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T14:40:10.449090+0000","last_peered":"2024-04-17T14:40:10.449090+0000","last_clean":"2024-04-17T14:40:10.449090+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T14:40:10.449090+0000","last_undegraded":"2024-04-17T14:40:10.449090+0000","last_fullsized":"2024-04-17T14:40:10.449090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450633+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T14:40:10.450633+0000","last_peered":"2024-04-17T14:40:10.450633+0000","last_clean":"2024-04-17T14:40:10.450633+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T14:40:10.450633+0000","last_undegraded":"2024-04-17T14:40:10.450633+0000","last_fullsized":"2024-04-17T14:40:10.450633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861171+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T14:40:09.861171+0000","last_peered":"2024-04-17T14:40:09.861171+0000","last_clean":"2024-04-17T14:40:09.861171+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T14:40:09.861171+0000","last_undegraded":"2024-04-17T14:40:09.861171+0000","last_fullsized":"2024-04-17T14:40:09.861171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448545+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T14:40:10.448545+0000","last_peered":"2024-04-17T14:40:10.448545+0000","last_clean":"2024-04-17T14:40:10.448545+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T14:40:10.448545+0000","last_undegraded":"2024-04-17T14:40:10.448545+0000","last_fullsized":"2024-04-17T14:40:10.448545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449962+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T14:40:10.449962+0000","last_peered":"2024-04-17T14:40:10.449962+0000","last_clean":"2024-04-17T14:40:10.449962+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T14:40:10.449962+0000","last_undegraded":"2024-04-17T14:40:10.449962+0000","last_fullsized":"2024-04-17T14:40:10.449962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451893+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T14:40:10.451893+0000","last_peered":"2024-04-17T14:40:10.451893+0000","last_clean":"2024-04-17T14:40:10.451893+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T14:40:10.451893+0000","last_undegraded":"2024-04-17T14:40:10.451893+0000","last_fullsized":"2024-04-17T14:40:10.451893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862015+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T14:40:09.862015+0000","last_peered":"2024-04-17T14:40:09.862015+0000","last_clean":"2024-04-17T14:40:09.862015+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T14:40:09.862015+0000","last_undegraded":"2024-04-17T14:40:09.862015+0000","last_fullsized":"2024-04-17T14:40:09.862015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449733+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T14:40:10.449733+0000","last_peered":"2024-04-17T14:40:10.449733+0000","last_clean":"2024-04-17T14:40:10.449733+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T14:40:10.449733+0000","last_undegraded":"2024-04-17T14:40:10.449733+0000","last_fullsized":"2024-04-17T14:40:10.449733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818833+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T14:40:09.818833+0000","last_peered":"2024-04-17T14:40:09.818833+0000","last_clean":"2024-04-17T14:40:09.818833+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T14:40:09.818833+0000","last_undegraded":"2024-04-17T14:40:09.818833+0000","last_fullsized":"2024-04-17T14:40:09.818833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449580+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T14:40:10.449580+0000","last_peered":"2024-04-17T14:40:10.449580+0000","last_clean":"2024-04-17T14:40:10.449580+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T14:40:10.449580+0000","last_undegraded":"2024-04-17T14:40:10.449580+0000","last_fullsized":"2024-04-17T14:40:10.449580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.854221+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T14:40:09.854221+0000","last_peered":"2024-04-17T14:40:09.854221+0000","last_clean":"2024-04-17T14:40:09.854221+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T14:40:09.854221+0000","last_undegraded":"2024-04-17T14:40:09.854221+0000","last_fullsized":"2024-04-17T14:40:09.854221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449995+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T14:40:10.449995+0000","last_peered":"2024-04-17T14:40:10.449995+0000","last_clean":"2024-04-17T14:40:10.449995+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T14:40:10.449995+0000","last_undegraded":"2024-04-17T14:40:10.449995+0000","last_fullsized":"2024-04-17T14:40:10.449995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450500+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T14:40:10.450500+0000","last_peered":"2024-04-17T14:40:10.450500+0000","last_clean":"2024-04-17T14:40:10.450500+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T14:40:10.450500+0000","last_undegraded":"2024-04-17T14:40:10.450500+0000","last_fullsized":"2024-04-17T14:40:10.450500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449560+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T14:40:10.449560+0000","last_peered":"2024-04-17T14:40:10.449560+0000","last_clean":"2024-04-17T14:40:10.449560+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T14:40:10.449560+0000","last_undegraded":"2024-04-17T14:40:10.449560+0000","last_fullsized":"2024-04-17T14:40:10.449560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861512+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T14:40:09.861512+0000","last_peered":"2024-04-17T14:40:09.861512+0000","last_clean":"2024-04-17T14:40:09.861512+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T14:40:09.861512+0000","last_undegraded":"2024-04-17T14:40:09.861512+0000","last_fullsized":"2024-04-17T14:40:09.861512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448786+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T14:40:10.448786+0000","last_peered":"2024-04-17T14:40:10.448786+0000","last_clean":"2024-04-17T14:40:10.448786+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T14:40:10.448786+0000","last_undegraded":"2024-04-17T14:40:10.448786+0000","last_fullsized":"2024-04-17T14:40:10.448786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853018+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T14:40:09.853018+0000","last_peered":"2024-04-17T14:40:09.853018+0000","last_clean":"2024-04-17T14:40:09.853018+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T14:40:09.853018+0000","last_undegraded":"2024-04-17T14:40:09.853018+0000","last_fullsized":"2024-04-17T14:40:09.853018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868077+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T14:40:09.868077+0000","last_peered":"2024-04-17T14:40:09.868077+0000","last_clean":"2024-04-17T14:40:09.868077+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T14:40:09.868077+0000","last_undegraded":"2024-04-17T14:40:09.868077+0000","last_fullsized":"2024-04-17T14:40:09.868077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817735+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T14:40:09.817735+0000","last_peered":"2024-04-17T14:40:09.817735+0000","last_clean":"2024-04-17T14:40:09.817735+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T14:40:09.817735+0000","last_undegraded":"2024-04-17T14:40:09.817735+0000","last_fullsized":"2024-04-17T14:40:09.817735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449244+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T14:40:10.449244+0000","last_peered":"2024-04-17T14:40:10.449244+0000","last_clean":"2024-04-17T14:40:10.449244+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T14:40:10.449244+0000","last_undegraded":"2024-04-17T14:40:10.449244+0000","last_fullsized":"2024-04-17T14:40:10.449244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.458313+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T14:40:10.458313+0000","last_peered":"2024-04-17T14:40:10.458313+0000","last_clean":"2024-04-17T14:40:10.458313+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T14:40:10.458313+0000","last_undegraded":"2024-04-17T14:40:10.458313+0000","last_fullsized":"2024-04-17T14:40:10.458313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818661+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T14:40:09.818661+0000","last_peered":"2024-04-17T14:40:09.818661+0000","last_clean":"2024-04-17T14:40:09.818661+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T14:40:09.818661+0000","last_undegraded":"2024-04-17T14:40:09.818661+0000","last_fullsized":"2024-04-17T14:40:09.818661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451669+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T14:40:10.451669+0000","last_peered":"2024-04-17T14:40:10.451669+0000","last_clean":"2024-04-17T14:40:10.451669+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T14:40:10.451669+0000","last_undegraded":"2024-04-17T14:40:10.451669+0000","last_fullsized":"2024-04-17T14:40:10.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450158+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T14:40:10.450158+0000","last_peered":"2024-04-17T14:40:10.450158+0000","last_clean":"2024-04-17T14:40:10.450158+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T14:40:10.450158+0000","last_undegraded":"2024-04-17T14:40:10.450158+0000","last_fullsized":"2024-04-17T14:40:10.450158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853913+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T14:40:09.853913+0000","last_peered":"2024-04-17T14:40:09.853913+0000","last_clean":"2024-04-17T14:40:09.853913+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T14:40:09.853913+0000","last_undegraded":"2024-04-17T14:40:09.853913+0000","last_fullsized":"2024-04-17T14:40:09.853913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862297+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T14:40:09.862297+0000","last_peered":"2024-04-17T14:40:09.862297+0000","last_clean":"2024-04-17T14:40:09.862297+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T14:40:09.862297+0000","last_undegraded":"2024-04-17T14:40:09.862297+0000","last_fullsized":"2024-04-17T14:40:09.862297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861758+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T14:40:09.861758+0000","last_peered":"2024-04-17T14:40:09.861758+0000","last_clean":"2024-04-17T14:40:09.861758+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T14:40:09.861758+0000","last_undegraded":"2024-04-17T14:40:09.861758+0000","last_fullsized":"2024-04-17T14:40:09.861758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450582+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T14:40:10.450582+0000","last_peered":"2024-04-17T14:40:10.450582+0000","last_clean":"2024-04-17T14:40:10.450582+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T14:40:10.450582+0000","last_undegraded":"2024-04-17T14:40:10.450582+0000","last_fullsized":"2024-04-17T14:40:10.450582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861508+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T14:40:09.861508+0000","last_peered":"2024-04-17T14:40:09.861508+0000","last_clean":"2024-04-17T14:40:09.861508+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T14:40:09.861508+0000","last_undegraded":"2024-04-17T14:40:09.861508+0000","last_fullsized":"2024-04-17T14:40:09.861508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448960+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T14:40:10.448960+0000","last_peered":"2024-04-17T14:40:10.448960+0000","last_clean":"2024-04-17T14:40:10.448960+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T14:40:10.448960+0000","last_undegraded":"2024-04-17T14:40:10.448960+0000","last_fullsized":"2024-04-17T14:40:10.448960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448673+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T14:40:10.448673+0000","last_peered":"2024-04-17T14:40:10.448673+0000","last_clean":"2024-04-17T14:40:10.448673+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T14:40:10.448673+0000","last_undegraded":"2024-04-17T14:40:10.448673+0000","last_fullsized":"2024-04-17T14:40:10.448673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861712+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T14:40:09.861712+0000","last_peered":"2024-04-17T14:40:09.861712+0000","last_clean":"2024-04-17T14:40:09.861712+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T14:40:09.861712+0000","last_undegraded":"2024-04-17T14:40:09.861712+0000","last_fullsized":"2024-04-17T14:40:09.861712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861131+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T14:40:09.861131+0000","last_peered":"2024-04-17T14:40:09.861131+0000","last_clean":"2024-04-17T14:40:09.861131+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T14:40:09.861131+0000","last_undegraded":"2024-04-17T14:40:09.861131+0000","last_fullsized":"2024-04-17T14:40:09.861131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853567+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T14:40:09.853567+0000","last_peered":"2024-04-17T14:40:09.853567+0000","last_clean":"2024-04-17T14:40:09.853567+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T14:40:09.853567+0000","last_undegraded":"2024-04-17T14:40:09.853567+0000","last_fullsized":"2024-04-17T14:40:09.853567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868466+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T14:40:09.868466+0000","last_peered":"2024-04-17T14:40:09.868466+0000","last_clean":"2024-04-17T14:40:09.868466+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T14:40:09.868466+0000","last_undegraded":"2024-04-17T14:40:09.868466+0000","last_fullsized":"2024-04-17T14:40:09.868466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449468+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T14:40:10.449468+0000","last_peered":"2024-04-17T14:40:10.449468+0000","last_clean":"2024-04-17T14:40:10.449468+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T14:40:10.449468+0000","last_undegraded":"2024-04-17T14:40:10.449468+0000","last_fullsized":"2024-04-17T14:40:10.449468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448987+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T14:40:10.448987+0000","last_peered":"2024-04-17T14:40:10.448987+0000","last_clean":"2024-04-17T14:40:10.448987+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T14:40:10.448987+0000","last_undegraded":"2024-04-17T14:40:10.448987+0000","last_fullsized":"2024-04-17T14:40:10.448987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449914+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T14:40:10.449914+0000","last_peered":"2024-04-17T14:40:10.449914+0000","last_clean":"2024-04-17T14:40:10.449914+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T14:40:10.449914+0000","last_undegraded":"2024-04-17T14:40:10.449914+0000","last_fullsized":"2024-04-17T14:40:10.449914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449857+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T14:40:10.449857+0000","last_peered":"2024-04-17T14:40:10.449857+0000","last_clean":"2024-04-17T14:40:10.449857+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T14:40:10.449857+0000","last_undegraded":"2024-04-17T14:40:10.449857+0000","last_fullsized":"2024-04-17T14:40:10.449857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450596+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T14:40:10.450596+0000","last_peered":"2024-04-17T14:40:10.450596+0000","last_clean":"2024-04-17T14:40:10.450596+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T14:40:10.450596+0000","last_undegraded":"2024-04-17T14:40:10.450596+0000","last_fullsized":"2024-04-17T14:40:10.450596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449742+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T14:40:10.449742+0000","last_peered":"2024-04-17T14:40:10.449742+0000","last_clean":"2024-04-17T14:40:10.449742+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T14:40:10.449742+0000","last_undegraded":"2024-04-17T14:40:10.449742+0000","last_fullsized":"2024-04-17T14:40:10.449742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819064+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T14:40:09.819064+0000","last_peered":"2024-04-17T14:40:09.819064+0000","last_clean":"2024-04-17T14:40:09.819064+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T14:40:09.819064+0000","last_undegraded":"2024-04-17T14:40:09.819064+0000","last_fullsized":"2024-04-17T14:40:09.819064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819189+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T14:40:09.819189+0000","last_peered":"2024-04-17T14:40:09.819189+0000","last_clean":"2024-04-17T14:40:09.819189+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T14:40:09.819189+0000","last_undegraded":"2024-04-17T14:40:09.819189+0000","last_fullsized":"2024-04-17T14:40:09.819189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818884+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T14:40:09.818884+0000","last_peered":"2024-04-17T14:40:09.818884+0000","last_clean":"2024-04-17T14:40:09.818884+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T14:40:09.818884+0000","last_undegraded":"2024-04-17T14:40:09.818884+0000","last_fullsized":"2024-04-17T14:40:09.818884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862034+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T14:40:09.862034+0000","last_peered":"2024-04-17T14:40:09.862034+0000","last_clean":"2024-04-17T14:40:09.862034+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T14:40:09.862034+0000","last_undegraded":"2024-04-17T14:40:09.862034+0000","last_fullsized":"2024-04-17T14:40:09.862034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":96744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":95042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":96072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":684898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":94516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":684920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T14:40:15.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T14:40:15.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 Processor -- start 2024-04-17T14:40:15.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 -- start start 2024-04-17T14:40:15.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45480c5570 0x7f45480c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4548153330 con 0x7f4548071760 2024-04-17T14:40:15.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454815c2b0 con 0x7f4548152f50 2024-04-17T14:40:15.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454fe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f45480c95f0 con 0x7f45480c5570 2024-04-17T14:40:15.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454de00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4548071760 0x7f4548071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43226/0 (socket says 172.21.15.16:43226) 2024-04-17T14:40:15.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.239+0000 7f454de00640 1 -- 172.21.15.16:0/3428905433 learned_addr learned my addr 172.21.15.16:0/3428905433 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:15.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.243+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129642411 0 0) 0x7f4548153330 con 0x7f4548071760 2024-04-17T14:40:15.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.243+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4530003530 con 0x7f4548071760 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f454ca00640 1 --2- 172.21.15.16:0/3428905433 >> v2:172.21.15.67:3300/0 conn(0x7f45480c5570 0x7f45480c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030063164 0 0) 0x7f4530003530 con 0x7f4548071760 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 >> v2:172.21.15.67:3300/0 conn(0x7f45480c5570 msgr2=0x7f45480c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 --2- 172.21.15.16:0/3428905433 >> v2:172.21.15.67:3300/0 conn(0x7f45480c5570 0x7f45480c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 >> v1:172.21.15.67:6789/0 conn(0x7f4548152f50 legacy=0x7f45480c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:15.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454815c590 con 0x7f4548071760 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f4540001a00 con 0x7f4548071760 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 >> v1:172.21.15.16:6789/0 conn(0x7f4548071760 legacy=0x7f4548071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4530003a10 0x7f4530003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530005420 0x7f453000ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f453000c330 con 0x7f4530004810 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f453000c4e0 con 0x7f4530005420 2024-04-17T14:40:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f453000c6e0 con 0x7f4530003a10 2024-04-17T14:40:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f454d400640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4530003a10 0x7f4530003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:15.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.247+0000 7f454ca00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:15.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454ca00640 1 -- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4530003a10 msgr2=0x7f4530003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:15.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454ca00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4530003a10 0x7f4530003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454ca00640 1 -- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530005420 msgr2=0x7f453000ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:15.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454ca00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530005420 0x7f453000ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454ca00640 1 -- 172.21.15.16:0/3428905433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4530003530 con 0x7f4530004810 2024-04-17T14:40:15.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.255+0000 7f454de00640 1 -- 172.21.15.16:0/3428905433 reap_dead start 2024-04-17T14:40:15.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.267+0000 7f454ca00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 0x7f4530004c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f453400a990 tx=0x7f453401c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ce093372466791 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:15.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340b0070 con 0x7f4530004810 2024-04-17T14:40:15.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45340ab600 con 0x7f4530004810 2024-04-17T14:40:15.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f4547e00640 1 -- 172.21.15.16:0/3428905433 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453400a590 con 0x7f4530004810 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 -- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 msgr2=0x7f4530004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 0x7f4530004c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f453400a990 tx=0x7f453401c5b0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 -- 172.21.15.16:0/3428905433 shutdown_connections 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 --2- 172.21.15.16:0/3428905433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 -- 172.21.15.16:0/3428905433 >> 172.21.15.16:0/3428905433 conn(0x7f454806dc40 msgr2=0x7f454806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 -- 172.21.15.16:0/3428905433 shutdown_connections 2024-04-17T14:40:15.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.323+0000 7f454fe00640 1 -- 172.21.15.16:0/3428905433 wait complete. 2024-04-17T14:40:15.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 Processor -- start 2024-04-17T14:40:15.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 -- start start 2024-04-17T14:40:15.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530004810 0x7f45481f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f454815afa0 0x7f454815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4548071f50 con 0x7f45480b23d0 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45480c3ee0 con 0x7f4530004810 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454fe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f45480720d0 con 0x7f454815afa0 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:15.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32960/0 (socket says 172.21.15.16:32960) 2024-04-17T14:40:15.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.327+0000 7f454de00640 1 -- 172.21.15.16:0/3126400391 learned_addr learned my addr 172.21.15.16:0/3126400391 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.331+0000 7f454de00640 1 -- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f454815afa0 msgr2=0x7f454815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.331+0000 7f454de00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f454815afa0 0x7f454815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.331+0000 7f454de00640 1 -- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530004810 msgr2=0x7f45481f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.331+0000 7f454de00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530004810 0x7f45481f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.331+0000 7f454de00640 1 -- 172.21.15.16:0/3126400391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45480b2850 con 0x7f45480b23d0 2024-04-17T14:40:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.335+0000 7f454de00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45480cbc60 tx=0x7f454000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454000ce50 con 0x7f45480b23d0 2024-04-17T14:40:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454000a5e0 con 0x7f45480b23d0 2024-04-17T14:40:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454000a990 con 0x7f45480b23d0 2024-04-17T14:40:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45480b15c0 con 0x7f45480b23d0 2024-04-17T14:40:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45480b1880 con 0x7f45480b23d0 2024-04-17T14:40:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.339+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4548076280 con 0x7f45480b23d0 2024-04-17T14:40:15.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.359+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f454000ab30 con 0x7f45480b23d0 2024-04-17T14:40:15.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.359+0000 7f4545600640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 0x7f452806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.359+0000 7f454d400640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 0x7f452806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.363+0000 7f454d400640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 0x7f452806a890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4548069200 tx=0x7f453c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:15.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.619+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f454000ae20 con 0x7f45480b23d0 2024-04-17T14:40:15.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.619+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f45480b2850 con 0x7f45480b23d0 2024-04-17T14:40:15.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.783+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45480711a0 con 0x7f45280683d0 2024-04-17T14:40:15.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.803+0000 7f4545600640 1 -- 172.21.15.16:0/3126400391 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251823 (secure 0 0 0) 0x7f45480711a0 con 0x7f45280683d0 2024-04-17T14:40:15.804 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:15.805 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.803+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 msgr2=0x7f452806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.803+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 0x7f452806a890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4548069200 tx=0x7f453c009040 comp rx=0 tx=0).stop 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.803+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 msgr2=0x7f454815b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.803+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45480cbc60 tx=0x7f454000cc00 comp rx=0 tx=0).stop 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 shutdown_connections 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45280683d0 0x7f452806a890 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45480b23d0 0x7f454815b820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f454815afa0 0x7f454815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 --2- 172.21.15.16:0/3126400391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530004810 0x7f45481f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:15.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 >> 172.21.15.16:0/3126400391 conn(0x7f454806dc40 msgr2=0x7f45481521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:15.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 shutdown_connections 2024-04-17T14:40:15.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:15.807+0000 7f454fe00640 1 -- 172.21.15.16:0/3126400391 wait complete. 2024-04-17T14:40:15.824 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-17T14:40:15.006030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236040,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738680,"statfs":{"total":773094113280,"available":772852408320,"internally_reserved":0,"allocated":3317760,"data_stored":1941236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003856"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449636+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T14:40:10.449636+0000","last_peered":"2024-04-17T14:40:10.449636+0000","last_clean":"2024-04-17T14:40:10.449636+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T14:40:10.449636+0000","last_undegraded":"2024-04-17T14:40:10.449636+0000","last_fullsized":"2024-04-17T14:40:10.449636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818783+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T14:40:09.818783+0000","last_peered":"2024-04-17T14:40:09.818783+0000","last_clean":"2024-04-17T14:40:09.818783+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T14:40:09.818783+0000","last_undegraded":"2024-04-17T14:40:09.818783+0000","last_fullsized":"2024-04-17T14:40:09.818783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818580+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T14:40:09.818580+0000","last_peered":"2024-04-17T14:40:09.818580+0000","last_clean":"2024-04-17T14:40:09.818580+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T14:40:09.818580+0000","last_undegraded":"2024-04-17T14:40:09.818580+0000","last_fullsized":"2024-04-17T14:40:09.818580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451428+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T14:40:10.451428+0000","last_peered":"2024-04-17T14:40:10.451428+0000","last_clean":"2024-04-17T14:40:10.451428+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T14:40:10.451428+0000","last_undegraded":"2024-04-17T14:40:10.451428+0000","last_fullsized":"2024-04-17T14:40:10.451428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449463+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T14:40:10.449463+0000","last_peered":"2024-04-17T14:40:10.449463+0000","last_clean":"2024-04-17T14:40:10.449463+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T14:40:10.449463+0000","last_undegraded":"2024-04-17T14:40:10.449463+0000","last_fullsized":"2024-04-17T14:40:10.449463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450151+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T14:40:10.450151+0000","last_peered":"2024-04-17T14:40:10.450151+0000","last_clean":"2024-04-17T14:40:10.450151+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T14:40:10.450151+0000","last_undegraded":"2024-04-17T14:40:10.450151+0000","last_fullsized":"2024-04-17T14:40:10.450151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449037+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T14:40:10.449037+0000","last_peered":"2024-04-17T14:40:10.449037+0000","last_clean":"2024-04-17T14:40:10.449037+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T14:40:10.449037+0000","last_undegraded":"2024-04-17T14:40:10.449037+0000","last_fullsized":"2024-04-17T14:40:10.449037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818266+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T14:40:09.818266+0000","last_peered":"2024-04-17T14:40:09.818266+0000","last_clean":"2024-04-17T14:40:09.818266+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T14:40:09.818266+0000","last_undegraded":"2024-04-17T14:40:09.818266+0000","last_fullsized":"2024-04-17T14:40:09.818266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450788+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T14:40:10.450788+0000","last_peered":"2024-04-17T14:40:10.450788+0000","last_clean":"2024-04-17T14:40:10.450788+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T14:40:10.450788+0000","last_undegraded":"2024-04-17T14:40:10.450788+0000","last_fullsized":"2024-04-17T14:40:10.450788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449498+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T14:40:10.449498+0000","last_peered":"2024-04-17T14:40:10.449498+0000","last_clean":"2024-04-17T14:40:10.449498+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T14:40:10.449498+0000","last_undegraded":"2024-04-17T14:40:10.449498+0000","last_fullsized":"2024-04-17T14:40:10.449498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449333+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T14:40:10.449333+0000","last_peered":"2024-04-17T14:40:10.449333+0000","last_clean":"2024-04-17T14:40:10.449333+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T14:40:10.449333+0000","last_undegraded":"2024-04-17T14:40:10.449333+0000","last_fullsized":"2024-04-17T14:40:10.449333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449382+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T14:40:10.449382+0000","last_peered":"2024-04-17T14:40:10.449382+0000","last_clean":"2024-04-17T14:40:10.449382+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T14:40:10.449382+0000","last_undegraded":"2024-04-17T14:40:10.449382+0000","last_fullsized":"2024-04-17T14:40:10.449382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853599+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T14:40:09.853599+0000","last_peered":"2024-04-17T14:40:09.853599+0000","last_clean":"2024-04-17T14:40:09.853599+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T14:40:09.853599+0000","last_undegraded":"2024-04-17T14:40:09.853599+0000","last_fullsized":"2024-04-17T14:40:09.853599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853086+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T14:40:09.853086+0000","last_peered":"2024-04-17T14:40:09.853086+0000","last_clean":"2024-04-17T14:40:09.853086+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T14:40:09.853086+0000","last_undegraded":"2024-04-17T14:40:09.853086+0000","last_fullsized":"2024-04-17T14:40:09.853086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817655+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T14:40:09.817655+0000","last_peered":"2024-04-17T14:40:09.817655+0000","last_clean":"2024-04-17T14:40:09.817655+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T14:40:09.817655+0000","last_undegraded":"2024-04-17T14:40:09.817655+0000","last_fullsized":"2024-04-17T14:40:09.817655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448495+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T14:40:10.448495+0000","last_peered":"2024-04-17T14:40:10.448495+0000","last_clean":"2024-04-17T14:40:10.448495+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T14:40:10.448495+0000","last_undegraded":"2024-04-17T14:40:10.448495+0000","last_fullsized":"2024-04-17T14:40:10.448495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450539+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T14:40:10.450539+0000","last_peered":"2024-04-17T14:40:10.450539+0000","last_clean":"2024-04-17T14:40:10.450539+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T14:40:10.450539+0000","last_undegraded":"2024-04-17T14:40:10.450539+0000","last_fullsized":"2024-04-17T14:40:10.450539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868835+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T14:40:09.868835+0000","last_peered":"2024-04-17T14:40:09.868835+0000","last_clean":"2024-04-17T14:40:09.868835+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T14:40:09.868835+0000","last_undegraded":"2024-04-17T14:40:09.868835+0000","last_fullsized":"2024-04-17T14:40:09.868835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450076+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T14:40:10.450076+0000","last_peered":"2024-04-17T14:40:10.450076+0000","last_clean":"2024-04-17T14:40:10.450076+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T14:40:10.450076+0000","last_undegraded":"2024-04-17T14:40:10.450076+0000","last_fullsized":"2024-04-17T14:40:10.450076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449491+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T14:40:10.449491+0000","last_peered":"2024-04-17T14:40:10.449491+0000","last_clean":"2024-04-17T14:40:10.449491+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T14:40:10.449491+0000","last_undegraded":"2024-04-17T14:40:10.449491+0000","last_fullsized":"2024-04-17T14:40:10.449491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861763+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T14:40:09.861763+0000","last_peered":"2024-04-17T14:40:09.861763+0000","last_clean":"2024-04-17T14:40:09.861763+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T14:40:09.861763+0000","last_undegraded":"2024-04-17T14:40:09.861763+0000","last_fullsized":"2024-04-17T14:40:09.861763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449653+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T14:40:10.449653+0000","last_peered":"2024-04-17T14:40:10.449653+0000","last_clean":"2024-04-17T14:40:10.449653+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T14:40:10.449653+0000","last_undegraded":"2024-04-17T14:40:10.449653+0000","last_fullsized":"2024-04-17T14:40:10.449653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817982+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T14:40:09.817982+0000","last_peered":"2024-04-17T14:40:09.817982+0000","last_clean":"2024-04-17T14:40:09.817982+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T14:40:09.817982+0000","last_undegraded":"2024-04-17T14:40:09.817982+0000","last_fullsized":"2024-04-17T14:40:09.817982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448603+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T14:40:10.448603+0000","last_peered":"2024-04-17T14:40:10.448603+0000","last_clean":"2024-04-17T14:40:10.448603+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T14:40:10.448603+0000","last_undegraded":"2024-04-17T14:40:10.448603+0000","last_fullsized":"2024-04-17T14:40:10.448603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818852+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T14:40:09.818852+0000","last_peered":"2024-04-17T14:40:09.818852+0000","last_clean":"2024-04-17T14:40:09.818852+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T14:40:09.818852+0000","last_undegraded":"2024-04-17T14:40:09.818852+0000","last_fullsized":"2024-04-17T14:40:09.818852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451764+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T14:40:10.451764+0000","last_peered":"2024-04-17T14:40:10.451764+0000","last_clean":"2024-04-17T14:40:10.451764+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T14:40:10.451764+0000","last_undegraded":"2024-04-17T14:40:10.451764+0000","last_fullsized":"2024-04-17T14:40:10.451764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.854268+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T14:40:09.854268+0000","last_peered":"2024-04-17T14:40:09.854268+0000","last_clean":"2024-04-17T14:40:09.854268+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T14:40:09.854268+0000","last_undegraded":"2024-04-17T14:40:09.854268+0000","last_fullsized":"2024-04-17T14:40:09.854268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853751+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T14:40:09.853751+0000","last_peered":"2024-04-17T14:40:09.853751+0000","last_clean":"2024-04-17T14:40:09.853751+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T14:40:09.853751+0000","last_undegraded":"2024-04-17T14:40:09.853751+0000","last_fullsized":"2024-04-17T14:40:09.853751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818000+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T14:40:09.818000+0000","last_peered":"2024-04-17T14:40:09.818000+0000","last_clean":"2024-04-17T14:40:09.818000+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T14:40:09.818000+0000","last_undegraded":"2024-04-17T14:40:09.818000+0000","last_fullsized":"2024-04-17T14:40:09.818000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448902+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T14:40:10.448902+0000","last_peered":"2024-04-17T14:40:10.448902+0000","last_clean":"2024-04-17T14:40:10.448902+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T14:40:10.448902+0000","last_undegraded":"2024-04-17T14:40:10.448902+0000","last_fullsized":"2024-04-17T14:40:10.448902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.867900+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T14:40:09.867900+0000","last_peered":"2024-04-17T14:40:09.867900+0000","last_clean":"2024-04-17T14:40:09.867900+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T14:40:09.867900+0000","last_undegraded":"2024-04-17T14:40:09.867900+0000","last_fullsized":"2024-04-17T14:40:09.867900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449905+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T14:40:10.449905+0000","last_peered":"2024-04-17T14:40:10.449905+0000","last_clean":"2024-04-17T14:40:10.449905+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T14:40:10.449905+0000","last_undegraded":"2024-04-17T14:40:10.449905+0000","last_fullsized":"2024-04-17T14:40:10.449905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449749+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T14:40:10.449749+0000","last_peered":"2024-04-17T14:40:10.449749+0000","last_clean":"2024-04-17T14:40:10.449749+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T14:40:10.449749+0000","last_undegraded":"2024-04-17T14:40:10.449749+0000","last_fullsized":"2024-04-17T14:40:10.449749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818488+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T14:40:09.818488+0000","last_peered":"2024-04-17T14:40:09.818488+0000","last_clean":"2024-04-17T14:40:09.818488+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T14:40:09.818488+0000","last_undegraded":"2024-04-17T14:40:09.818488+0000","last_fullsized":"2024-04-17T14:40:09.818488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862316+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T14:40:09.862316+0000","last_peered":"2024-04-17T14:40:09.862316+0000","last_clean":"2024-04-17T14:40:09.862316+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T14:40:09.862316+0000","last_undegraded":"2024-04-17T14:40:09.862316+0000","last_fullsized":"2024-04-17T14:40:09.862316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449071+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T14:40:10.449071+0000","last_peered":"2024-04-17T14:40:10.449071+0000","last_clean":"2024-04-17T14:40:10.449071+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T14:40:10.449071+0000","last_undegraded":"2024-04-17T14:40:10.449071+0000","last_fullsized":"2024-04-17T14:40:10.449071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853117+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T14:40:09.853117+0000","last_peered":"2024-04-17T14:40:09.853117+0000","last_clean":"2024-04-17T14:40:09.853117+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T14:40:09.853117+0000","last_undegraded":"2024-04-17T14:40:09.853117+0000","last_fullsized":"2024-04-17T14:40:09.853117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818152+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T14:40:09.818152+0000","last_peered":"2024-04-17T14:40:09.818152+0000","last_clean":"2024-04-17T14:40:09.818152+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T14:40:09.818152+0000","last_undegraded":"2024-04-17T14:40:09.818152+0000","last_fullsized":"2024-04-17T14:40:09.818152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448694+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T14:40:10.448694+0000","last_peered":"2024-04-17T14:40:10.448694+0000","last_clean":"2024-04-17T14:40:10.448694+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T14:40:10.448694+0000","last_undegraded":"2024-04-17T14:40:10.448694+0000","last_fullsized":"2024-04-17T14:40:10.448694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861442+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T14:40:09.861442+0000","last_peered":"2024-04-17T14:40:09.861442+0000","last_clean":"2024-04-17T14:40:09.861442+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T14:40:09.861442+0000","last_undegraded":"2024-04-17T14:40:09.861442+0000","last_fullsized":"2024-04-17T14:40:09.861442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450978+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T14:40:10.450978+0000","last_peered":"2024-04-17T14:40:10.450978+0000","last_clean":"2024-04-17T14:40:10.450978+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T14:40:10.450978+0000","last_undegraded":"2024-04-17T14:40:10.450978+0000","last_fullsized":"2024-04-17T14:40:10.450978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451846+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T14:40:10.451846+0000","last_peered":"2024-04-17T14:40:10.451846+0000","last_clean":"2024-04-17T14:40:10.451846+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T14:40:10.451846+0000","last_undegraded":"2024-04-17T14:40:10.451846+0000","last_fullsized":"2024-04-17T14:40:10.451846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449719+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T14:40:10.449719+0000","last_peered":"2024-04-17T14:40:10.449719+0000","last_clean":"2024-04-17T14:40:10.449719+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T14:40:10.449719+0000","last_undegraded":"2024-04-17T14:40:10.449719+0000","last_fullsized":"2024-04-17T14:40:10.449719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819125+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T14:40:09.819125+0000","last_peered":"2024-04-17T14:40:09.819125+0000","last_clean":"2024-04-17T14:40:09.819125+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T14:40:09.819125+0000","last_undegraded":"2024-04-17T14:40:09.819125+0000","last_fullsized":"2024-04-17T14:40:09.819125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868780+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T14:40:09.868780+0000","last_peered":"2024-04-17T14:40:09.868780+0000","last_clean":"2024-04-17T14:40:09.868780+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T14:40:09.868780+0000","last_undegraded":"2024-04-17T14:40:09.868780+0000","last_fullsized":"2024-04-17T14:40:09.868780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449451+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T14:40:10.449451+0000","last_peered":"2024-04-17T14:40:10.449451+0000","last_clean":"2024-04-17T14:40:10.449451+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T14:40:10.449451+0000","last_undegraded":"2024-04-17T14:40:10.449451+0000","last_fullsized":"2024-04-17T14:40:10.449451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451526+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T14:40:10.451526+0000","last_peered":"2024-04-17T14:40:10.451526+0000","last_clean":"2024-04-17T14:40:10.451526+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T14:40:10.451526+0000","last_undegraded":"2024-04-17T14:40:10.451526+0000","last_fullsized":"2024-04-17T14:40:10.451526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449428+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T14:40:10.449428+0000","last_peered":"2024-04-17T14:40:10.449428+0000","last_clean":"2024-04-17T14:40:10.449428+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T14:40:10.449428+0000","last_undegraded":"2024-04-17T14:40:10.449428+0000","last_fullsized":"2024-04-17T14:40:10.449428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868746+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T14:40:09.868746+0000","last_peered":"2024-04-17T14:40:09.868746+0000","last_clean":"2024-04-17T14:40:09.868746+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T14:40:09.868746+0000","last_undegraded":"2024-04-17T14:40:09.868746+0000","last_fullsized":"2024-04-17T14:40:09.868746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853367+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T14:40:09.853367+0000","last_peered":"2024-04-17T14:40:09.853367+0000","last_clean":"2024-04-17T14:40:09.853367+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T14:40:09.853367+0000","last_undegraded":"2024-04-17T14:40:09.853367+0000","last_fullsized":"2024-04-17T14:40:09.853367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449163+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T14:40:10.449163+0000","last_peered":"2024-04-17T14:40:10.449163+0000","last_clean":"2024-04-17T14:40:10.449163+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T14:40:10.449163+0000","last_undegraded":"2024-04-17T14:40:10.449163+0000","last_fullsized":"2024-04-17T14:40:10.449163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449380+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T14:40:10.449380+0000","last_peered":"2024-04-17T14:40:10.449380+0000","last_clean":"2024-04-17T14:40:10.449380+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T14:40:10.449380+0000","last_undegraded":"2024-04-17T14:40:10.449380+0000","last_fullsized":"2024-04-17T14:40:10.449380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449090+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T14:40:10.449090+0000","last_peered":"2024-04-17T14:40:10.449090+0000","last_clean":"2024-04-17T14:40:10.449090+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T14:40:10.449090+0000","last_undegraded":"2024-04-17T14:40:10.449090+0000","last_fullsized":"2024-04-17T14:40:10.449090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450633+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T14:40:10.450633+0000","last_peered":"2024-04-17T14:40:10.450633+0000","last_clean":"2024-04-17T14:40:10.450633+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T14:40:10.450633+0000","last_undegraded":"2024-04-17T14:40:10.450633+0000","last_fullsized":"2024-04-17T14:40:10.450633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861171+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T14:40:09.861171+0000","last_peered":"2024-04-17T14:40:09.861171+0000","last_clean":"2024-04-17T14:40:09.861171+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T14:40:09.861171+0000","last_undegraded":"2024-04-17T14:40:09.861171+0000","last_fullsized":"2024-04-17T14:40:09.861171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448545+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T14:40:10.448545+0000","last_peered":"2024-04-17T14:40:10.448545+0000","last_clean":"2024-04-17T14:40:10.448545+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T14:40:10.448545+0000","last_undegraded":"2024-04-17T14:40:10.448545+0000","last_fullsized":"2024-04-17T14:40:10.448545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449962+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T14:40:10.449962+0000","last_peered":"2024-04-17T14:40:10.449962+0000","last_clean":"2024-04-17T14:40:10.449962+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T14:40:10.449962+0000","last_undegraded":"2024-04-17T14:40:10.449962+0000","last_fullsized":"2024-04-17T14:40:10.449962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451893+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T14:40:10.451893+0000","last_peered":"2024-04-17T14:40:10.451893+0000","last_clean":"2024-04-17T14:40:10.451893+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T14:40:10.451893+0000","last_undegraded":"2024-04-17T14:40:10.451893+0000","last_fullsized":"2024-04-17T14:40:10.451893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862015+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T14:40:09.862015+0000","last_peered":"2024-04-17T14:40:09.862015+0000","last_clean":"2024-04-17T14:40:09.862015+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T14:40:09.862015+0000","last_undegraded":"2024-04-17T14:40:09.862015+0000","last_fullsized":"2024-04-17T14:40:09.862015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449733+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T14:40:10.449733+0000","last_peered":"2024-04-17T14:40:10.449733+0000","last_clean":"2024-04-17T14:40:10.449733+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T14:40:10.449733+0000","last_undegraded":"2024-04-17T14:40:10.449733+0000","last_fullsized":"2024-04-17T14:40:10.449733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818833+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T14:40:09.818833+0000","last_peered":"2024-04-17T14:40:09.818833+0000","last_clean":"2024-04-17T14:40:09.818833+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T14:40:09.818833+0000","last_undegraded":"2024-04-17T14:40:09.818833+0000","last_fullsized":"2024-04-17T14:40:09.818833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449580+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T14:40:10.449580+0000","last_peered":"2024-04-17T14:40:10.449580+0000","last_clean":"2024-04-17T14:40:10.449580+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T14:40:10.449580+0000","last_undegraded":"2024-04-17T14:40:10.449580+0000","last_fullsized":"2024-04-17T14:40:10.449580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.854221+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T14:40:09.854221+0000","last_peered":"2024-04-17T14:40:09.854221+0000","last_clean":"2024-04-17T14:40:09.854221+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T14:40:09.854221+0000","last_undegraded":"2024-04-17T14:40:09.854221+0000","last_fullsized":"2024-04-17T14:40:09.854221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449995+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T14:40:10.449995+0000","last_peered":"2024-04-17T14:40:10.449995+0000","last_clean":"2024-04-17T14:40:10.449995+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T14:40:10.449995+0000","last_undegraded":"2024-04-17T14:40:10.449995+0000","last_fullsized":"2024-04-17T14:40:10.449995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450500+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T14:40:10.450500+0000","last_peered":"2024-04-17T14:40:10.450500+0000","last_clean":"2024-04-17T14:40:10.450500+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T14:40:10.450500+0000","last_undegraded":"2024-04-17T14:40:10.450500+0000","last_fullsized":"2024-04-17T14:40:10.450500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449560+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T14:40:10.449560+0000","last_peered":"2024-04-17T14:40:10.449560+0000","last_clean":"2024-04-17T14:40:10.449560+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T14:40:10.449560+0000","last_undegraded":"2024-04-17T14:40:10.449560+0000","last_fullsized":"2024-04-17T14:40:10.449560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861512+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T14:40:09.861512+0000","last_peered":"2024-04-17T14:40:09.861512+0000","last_clean":"2024-04-17T14:40:09.861512+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T14:40:09.861512+0000","last_undegraded":"2024-04-17T14:40:09.861512+0000","last_fullsized":"2024-04-17T14:40:09.861512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448786+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T14:40:10.448786+0000","last_peered":"2024-04-17T14:40:10.448786+0000","last_clean":"2024-04-17T14:40:10.448786+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T14:40:10.448786+0000","last_undegraded":"2024-04-17T14:40:10.448786+0000","last_fullsized":"2024-04-17T14:40:10.448786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853018+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T14:40:09.853018+0000","last_peered":"2024-04-17T14:40:09.853018+0000","last_clean":"2024-04-17T14:40:09.853018+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T14:40:09.853018+0000","last_undegraded":"2024-04-17T14:40:09.853018+0000","last_fullsized":"2024-04-17T14:40:09.853018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868077+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T14:40:09.868077+0000","last_peered":"2024-04-17T14:40:09.868077+0000","last_clean":"2024-04-17T14:40:09.868077+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T14:40:09.868077+0000","last_undegraded":"2024-04-17T14:40:09.868077+0000","last_fullsized":"2024-04-17T14:40:09.868077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.817735+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T14:40:09.817735+0000","last_peered":"2024-04-17T14:40:09.817735+0000","last_clean":"2024-04-17T14:40:09.817735+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T14:40:09.817735+0000","last_undegraded":"2024-04-17T14:40:09.817735+0000","last_fullsized":"2024-04-17T14:40:09.817735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449244+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T14:40:10.449244+0000","last_peered":"2024-04-17T14:40:10.449244+0000","last_clean":"2024-04-17T14:40:10.449244+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T14:40:10.449244+0000","last_undegraded":"2024-04-17T14:40:10.449244+0000","last_fullsized":"2024-04-17T14:40:10.449244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.458313+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T14:40:10.458313+0000","last_peered":"2024-04-17T14:40:10.458313+0000","last_clean":"2024-04-17T14:40:10.458313+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T14:40:10.458313+0000","last_undegraded":"2024-04-17T14:40:10.458313+0000","last_fullsized":"2024-04-17T14:40:10.458313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818661+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T14:40:09.818661+0000","last_peered":"2024-04-17T14:40:09.818661+0000","last_clean":"2024-04-17T14:40:09.818661+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T14:40:09.818661+0000","last_undegraded":"2024-04-17T14:40:09.818661+0000","last_fullsized":"2024-04-17T14:40:09.818661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.451669+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T14:40:10.451669+0000","last_peered":"2024-04-17T14:40:10.451669+0000","last_clean":"2024-04-17T14:40:10.451669+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T14:40:10.451669+0000","last_undegraded":"2024-04-17T14:40:10.451669+0000","last_fullsized":"2024-04-17T14:40:10.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450158+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T14:40:10.450158+0000","last_peered":"2024-04-17T14:40:10.450158+0000","last_clean":"2024-04-17T14:40:10.450158+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T14:40:10.450158+0000","last_undegraded":"2024-04-17T14:40:10.450158+0000","last_fullsized":"2024-04-17T14:40:10.450158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853913+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T14:40:09.853913+0000","last_peered":"2024-04-17T14:40:09.853913+0000","last_clean":"2024-04-17T14:40:09.853913+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T14:40:09.853913+0000","last_undegraded":"2024-04-17T14:40:09.853913+0000","last_fullsized":"2024-04-17T14:40:09.853913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862297+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T14:40:09.862297+0000","last_peered":"2024-04-17T14:40:09.862297+0000","last_clean":"2024-04-17T14:40:09.862297+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T14:40:09.862297+0000","last_undegraded":"2024-04-17T14:40:09.862297+0000","last_fullsized":"2024-04-17T14:40:09.862297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861758+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T14:40:09.861758+0000","last_peered":"2024-04-17T14:40:09.861758+0000","last_clean":"2024-04-17T14:40:09.861758+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T14:40:09.861758+0000","last_undegraded":"2024-04-17T14:40:09.861758+0000","last_fullsized":"2024-04-17T14:40:09.861758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450582+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T14:40:10.450582+0000","last_peered":"2024-04-17T14:40:10.450582+0000","last_clean":"2024-04-17T14:40:10.450582+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T14:40:10.450582+0000","last_undegraded":"2024-04-17T14:40:10.450582+0000","last_fullsized":"2024-04-17T14:40:10.450582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861508+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T14:40:09.861508+0000","last_peered":"2024-04-17T14:40:09.861508+0000","last_clean":"2024-04-17T14:40:09.861508+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T14:40:09.861508+0000","last_undegraded":"2024-04-17T14:40:09.861508+0000","last_fullsized":"2024-04-17T14:40:09.861508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448960+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T14:40:10.448960+0000","last_peered":"2024-04-17T14:40:10.448960+0000","last_clean":"2024-04-17T14:40:10.448960+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T14:40:10.448960+0000","last_undegraded":"2024-04-17T14:40:10.448960+0000","last_fullsized":"2024-04-17T14:40:10.448960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448673+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T14:40:10.448673+0000","last_peered":"2024-04-17T14:40:10.448673+0000","last_clean":"2024-04-17T14:40:10.448673+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T14:40:10.448673+0000","last_undegraded":"2024-04-17T14:40:10.448673+0000","last_fullsized":"2024-04-17T14:40:10.448673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861712+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T14:40:09.861712+0000","last_peered":"2024-04-17T14:40:09.861712+0000","last_clean":"2024-04-17T14:40:09.861712+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T14:40:09.861712+0000","last_undegraded":"2024-04-17T14:40:09.861712+0000","last_fullsized":"2024-04-17T14:40:09.861712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.861131+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T14:40:09.861131+0000","last_peered":"2024-04-17T14:40:09.861131+0000","last_clean":"2024-04-17T14:40:09.861131+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T14:40:09.861131+0000","last_undegraded":"2024-04-17T14:40:09.861131+0000","last_fullsized":"2024-04-17T14:40:09.861131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.853567+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T14:40:09.853567+0000","last_peered":"2024-04-17T14:40:09.853567+0000","last_clean":"2024-04-17T14:40:09.853567+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T14:40:09.853567+0000","last_undegraded":"2024-04-17T14:40:09.853567+0000","last_fullsized":"2024-04-17T14:40:09.853567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.868466+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T14:40:09.868466+0000","last_peered":"2024-04-17T14:40:09.868466+0000","last_clean":"2024-04-17T14:40:09.868466+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T14:40:09.868466+0000","last_undegraded":"2024-04-17T14:40:09.868466+0000","last_fullsized":"2024-04-17T14:40:09.868466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449468+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T14:40:10.449468+0000","last_peered":"2024-04-17T14:40:10.449468+0000","last_clean":"2024-04-17T14:40:10.449468+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T14:40:10.449468+0000","last_undegraded":"2024-04-17T14:40:10.449468+0000","last_fullsized":"2024-04-17T14:40:10.449468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.448987+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T14:40:10.448987+0000","last_peered":"2024-04-17T14:40:10.448987+0000","last_clean":"2024-04-17T14:40:10.448987+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T14:40:10.448987+0000","last_undegraded":"2024-04-17T14:40:10.448987+0000","last_fullsized":"2024-04-17T14:40:10.448987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449914+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T14:40:10.449914+0000","last_peered":"2024-04-17T14:40:10.449914+0000","last_clean":"2024-04-17T14:40:10.449914+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T14:40:10.449914+0000","last_undegraded":"2024-04-17T14:40:10.449914+0000","last_fullsized":"2024-04-17T14:40:10.449914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449857+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T14:40:10.449857+0000","last_peered":"2024-04-17T14:40:10.449857+0000","last_clean":"2024-04-17T14:40:10.449857+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T14:40:10.449857+0000","last_undegraded":"2024-04-17T14:40:10.449857+0000","last_fullsized":"2024-04-17T14:40:10.449857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.450596+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T14:40:10.450596+0000","last_peered":"2024-04-17T14:40:10.450596+0000","last_clean":"2024-04-17T14:40:10.450596+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T14:40:10.450596+0000","last_undegraded":"2024-04-17T14:40:10.450596+0000","last_fullsized":"2024-04-17T14:40:10.450596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:10.449742+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T14:40:10.449742+0000","last_peered":"2024-04-17T14:40:10.449742+0000","last_clean":"2024-04-17T14:40:10.449742+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T14:40:10.449742+0000","last_undegraded":"2024-04-17T14:40:10.449742+0000","last_fullsized":"2024-04-17T14:40:10.449742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819064+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T14:40:09.819064+0000","last_peered":"2024-04-17T14:40:09.819064+0000","last_clean":"2024-04-17T14:40:09.819064+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T14:40:09.819064+0000","last_undegraded":"2024-04-17T14:40:09.819064+0000","last_fullsized":"2024-04-17T14:40:09.819064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.819189+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T14:40:09.819189+0000","last_peered":"2024-04-17T14:40:09.819189+0000","last_clean":"2024-04-17T14:40:09.819189+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T14:40:09.819189+0000","last_undegraded":"2024-04-17T14:40:09.819189+0000","last_fullsized":"2024-04-17T14:40:09.819189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.818884+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T14:40:09.818884+0000","last_peered":"2024-04-17T14:40:09.818884+0000","last_clean":"2024-04-17T14:40:09.818884+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T14:40:09.818884+0000","last_undegraded":"2024-04-17T14:40:09.818884+0000","last_fullsized":"2024-04-17T14:40:09.818884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T14:40:09.862034+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T14:40:09.862034+0000","last_peered":"2024-04-17T14:40:09.862034+0000","last_clean":"2024-04-17T14:40:09.862034+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T14:40:09.862034+0000","last_undegraded":"2024-04-17T14:40:09.862034+0000","last_fullsized":"2024-04-17T14:40:09.862034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":96744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":95042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":96072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":684898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":94516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":684920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T14:40:15.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T14:40:15.828 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T14:40:15.828 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T14:40:15.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T14:40:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.011+0000 7ffa95000640 1 Processor -- start 2024-04-17T14:40:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.011+0000 7ffa95000640 1 -- start start 2024-04-17T14:40:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.011+0000 7ffa95000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa90151db0 0x7ffa900c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.011+0000 7ffa95000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa9015be40 0x7ffa90157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.011+0000 7ffa95000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa90158610 con 0x7ffa90158110 2024-04-17T14:40:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa95000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffa900c8be0 con 0x7ffa9015be40 2024-04-17T14:40:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa95000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ffa90071b30 con 0x7ffa90151db0 2024-04-17T14:40:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa9015be40 0x7ffa90157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa9015be40 0x7ffa90157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32972/0 (socket says 172.21.15.16:32972) 2024-04-17T14:40:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 -- 172.21.15.16:0/2236412595 learned_addr learned my addr 172.21.15.16:0/2236412595 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa8de00640 1 --2- 172.21.15.16:0/2236412595 >> v2:172.21.15.67:3300/0 conn(0x7ffa90151db0 0x7ffa900c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 -- 172.21.15.16:0/2236412595 >> v2:172.21.15.67:3300/0 conn(0x7ffa90151db0 msgr2=0x7ffa900c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 --2- 172.21.15.16:0/2236412595 >> v2:172.21.15.67:3300/0 conn(0x7ffa90151db0 0x7ffa900c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 -- 172.21.15.16:0/2236412595 >> v1:172.21.15.67:6789/0 conn(0x7ffa90158110 legacy=0x7ffa900c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.015+0000 7ffa85400640 1 -- 172.21.15.16:0/2236412595 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa901588f0 con 0x7ffa9015be40 2024-04-17T14:40:16.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.019+0000 7ffa85400640 1 --2- 172.21.15.16:0/2236412595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90157bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa90070020 tx=0x7ffa7801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e11e7991ab2486f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.023+0000 7ffa8d400640 1 -- 172.21.15.16:0/2236412595 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa780b5070 con 0x7ffa9015be40 2024-04-17T14:40:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa8d400640 1 -- 172.21.15.16:0/2236412595 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa780a89d0 con 0x7ffa9015be40 2024-04-17T14:40:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa8d400640 1 -- 172.21.15.16:0/2236412595 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa780a8da0 con 0x7ffa9015be40 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- 172.21.15.16:0/2236412595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 msgr2=0x7ffa90157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- 172.21.15.16:0/2236412595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90157bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa90070020 tx=0x7ffa7801ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- 172.21.15.16:0/2236412595 shutdown_connections 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- 172.21.15.16:0/2236412595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90157bd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- 172.21.15.16:0/2236412595 >> v2:172.21.15.67:3300/0 conn(0x7ffa90151db0 0x7ffa900c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- 172.21.15.16:0/2236412595 >> 172.21.15.16:0/2236412595 conn(0x7ffa9006ba30 msgr2=0x7ffa9006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- 172.21.15.16:0/2236412595 shutdown_connections 2024-04-17T14:40:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- 172.21.15.16:0/2236412595 wait complete. 2024-04-17T14:40:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 Processor -- start 2024-04-17T14:40:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- start start 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa90151db0 0x7ffa90154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa90158110 0x7ffa901f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9015b920 con 0x7ffa9015be40 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9015b640 con 0x7ffa90158110 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.027+0000 7ffa95000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7ffa900c4080 con 0x7ffa90151db0 2024-04-17T14:40:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.031+0000 7ffa8e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.031+0000 7ffa8e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32986/0 (socket says 172.21.15.16:32986) 2024-04-17T14:40:16.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.031+0000 7ffa8e800640 1 -- 172.21.15.16:0/154458893 learned_addr learned my addr 172.21.15.16:0/154458893 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.031+0000 7ffa8de00640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa90151db0 0x7ffa90154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.031+0000 7ffa85400640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa90158110 0x7ffa901f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 -- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa90151db0 msgr2=0x7ffa90154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa90151db0 0x7ffa90154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 -- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa90158110 msgr2=0x7ffa901f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa90158110 0x7ffa901f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 -- 172.21.15.16:0/154458893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9014ea40 con 0x7ffa9015be40 2024-04-17T14:40:16.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.035+0000 7ffa8e800640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c440 tx=0x7ffa8800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88017070 con 0x7ffa9015be40 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa88003600 con 0x7ffa9015be40 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880039f0 con 0x7ffa9015be40 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9014e7a0 con 0x7ffa9015be40 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa901f0ea0 con 0x7ffa9015be40 2024-04-17T14:40:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.039+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa901f0c90 con 0x7ffa9015be40 2024-04-17T14:40:16.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.059+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa8801a070 con 0x7ffa9015be40 2024-04-17T14:40:16.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.063+0000 7ffa86a00640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 0x7ffa6c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.063+0000 7ffa8de00640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 0x7ffa6c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.063+0000 7ffa8de00640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 0x7ffa6c06a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa80011340 tx=0x7ffa8000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:16.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.319+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ffa88054110 con 0x7ffa9015be40 2024-04-17T14:40:16.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.319+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ffa88021020 con 0x7ffa9015be40 2024-04-17T14:40:16.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.527+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa90076280 con 0x7ffa9015be40 2024-04-17T14:40:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa86a00640 1 -- 172.21.15.16:0/154458893 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ffa88056070 con 0x7ffa9015be40 2024-04-17T14:40:16.534 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:16.534 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T14:40:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 msgr2=0x7ffa6c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 0x7ffa6c06a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa80011340 tx=0x7ffa8000b040 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 msgr2=0x7ffa90150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c440 tx=0x7ffa8800c900 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 shutdown_connections 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ffa6c068400 0x7ffa6c06a8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa9015be40 0x7ffa90150c80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa90158110 0x7ffa901f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.535+0000 7ffa95000640 1 --2- 172.21.15.16:0/154458893 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa90151db0 0x7ffa90154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.539+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 >> 172.21.15.16:0/154458893 conn(0x7ffa9006ba30 msgr2=0x7ffa90147f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.539+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 shutdown_connections 2024-04-17T14:40:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.539+0000 7ffa95000640 1 -- 172.21.15.16:0/154458893 wait complete. 2024-04-17T14:40:16.555 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T14:40:16.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:16.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 Processor -- start 2024-04-17T14:40:16.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 -- start start 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03440c8fd0 0x7f034415c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0344153200 con 0x7f03440c3580 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f03440b12c0 con 0x7f03440c8fd0 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f034a400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f03440cba60 con 0x7f0344152e20 2024-04-17T14:40:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f0349a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03440c8fd0 0x7f034415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f0349a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03440c8fd0 0x7f034415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32992/0 (socket says 172.21.15.16:32992) 2024-04-17T14:40:16.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f0349a00640 1 -- 172.21.15.16:0/2399393599 learned_addr learned my addr 172.21.15.16:0/2399393599 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:16.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.699+0000 7f0349000640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.703+0000 7f0349a00640 1 -- 172.21.15.16:0/2399393599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 msgr2=0x7f03440c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:16.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.703+0000 7f0349a00640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.703+0000 7f0349a00640 1 -- 172.21.15.16:0/2399393599 >> v1:172.21.15.16:6789/0 conn(0x7f03440c3580 legacy=0x7f03440700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.703+0000 7f0349a00640 1 -- 172.21.15.16:0/2399393599 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440cb170 con 0x7f03440c8fd0 2024-04-17T14:40:16.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.707+0000 7f0349a00640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c8fd0 0x7f034415c270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d66dfde04840a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:16.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f0343400640 1 -- 172.21.15.16:0/2399393599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b4070 con 0x7f03440c8fd0 2024-04-17T14:40:16.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f0343400640 1 -- 172.21.15.16:0/2399393599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0af400 con 0x7f03440c8fd0 2024-04-17T14:40:16.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f0343400640 1 -- 172.21.15.16:0/2399393599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0af7d0 con 0x7f03440c8fd0 2024-04-17T14:40:16.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 -- 172.21.15.16:0/2399393599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c8fd0 msgr2=0x7f034415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c8fd0 0x7f034415c270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c01f210 comp rx=0 tx=0).stop 2024-04-17T14:40:16.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 -- 172.21.15.16:0/2399393599 shutdown_connections 2024-04-17T14:40:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c8fd0 0x7f034415c270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 --2- 172.21.15.16:0/2399393599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 -- 172.21.15.16:0/2399393599 >> 172.21.15.16:0/2399393599 conn(0x7f0344062c10 msgr2=0x7f034406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 -- 172.21.15.16:0/2399393599 shutdown_connections 2024-04-17T14:40:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 -- 172.21.15.16:0/2399393599 wait complete. 2024-04-17T14:40:16.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.711+0000 7f034a400640 1 Processor -- start 2024-04-17T14:40:16.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 -- start start 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03440c8fd0 0x7f03440b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f03440cb410 con 0x7f03440c3580 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03440c3a50 con 0x7f03440c8fd0 2024-04-17T14:40:16.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f034a400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f03440cb6f0 con 0x7f0344152e20 2024-04-17T14:40:16.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f0349000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f0349000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33008/0 (socket says 172.21.15.16:33008) 2024-04-17T14:40:16.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f0349000640 1 -- 172.21.15.16:0/2434037019 learned_addr learned my addr 172.21.15.16:0/2434037019 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:16.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f0349a00640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.715+0000 7f0343e00640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03440c8fd0 0x7f03440b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 -- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 msgr2=0x7f03440b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 -- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03440c8fd0 msgr2=0x7f03440b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:16.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03440c8fd0 0x7f03440b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:16.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 -- 172.21.15.16:0/2434037019 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0344154960 con 0x7f03440c3580 2024-04-17T14:40:16.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.719+0000 7f0349000640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f033800e930 tx=0x7f033800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:16.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.723+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338017070 con 0x7f03440c3580 2024-04-17T14:40:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.723+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033800ca00 con 0x7f03440c3580 2024-04-17T14:40:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.723+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033800cdb0 con 0x7f03440c3580 2024-04-17T14:40:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.723+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03441f5350 con 0x7f03440c3580 2024-04-17T14:40:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.723+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0344153e80 con 0x7f03440c3580 2024-04-17T14:40:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.727+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03440761a0 con 0x7f03440c3580 2024-04-17T14:40:16.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.747+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f033801a070 con 0x7f03440c3580 2024-04-17T14:40:16.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.747+0000 7f0340c00640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 0x7f032406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:16.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.747+0000 7f0343e00640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 0x7f032406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:16.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:16.747+0000 7f0343e00640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 0x7f032406a8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03441eb880 tx=0x7f0330009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:17.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.003+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0338055210 con 0x7f03440c3580 2024-04-17T14:40:17.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.003+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0338057870 con 0x7f03440c3580 2024-04-17T14:40:17.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.183+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03440cd260 con 0x7f03440c3580 2024-04-17T14:40:17.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f0340c00640 1 -- 172.21.15.16:0/2434037019 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7f0338057170 con 0x7f03440c3580 2024-04-17T14:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 msgr2=0x7f032406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 0x7f032406a8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03441eb880 tx=0x7f0330009040 comp rx=0 tx=0).stop 2024-04-17T14:40:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 msgr2=0x7f03441f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f033800e930 tx=0x7f033800edf0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 shutdown_connections 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0324068400 0x7f032406a8c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0344152e20 0x7f03440b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03440c8fd0 0x7f03440b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 --2- 172.21.15.16:0/2434037019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03440c3580 0x7f03441f4710 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 >> 172.21.15.16:0/2434037019 conn(0x7f0344062c10 msgr2=0x7f03440cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 shutdown_connections 2024-04-17T14:40:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.223+0000 7f034a400640 1 -- 172.21.15.16:0/2434037019 wait complete. 2024-04-17T14:40:17.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T14:39:17.815818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T14:39:56.221860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T14:39:57.848198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T14:40:17.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T14:40:17.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 Processor -- start 2024-04-17T14:40:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 -- start start 2024-04-17T14:40:17.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 0x7f9a600c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a600c4fa0 con 0x7f9a60151ed0 2024-04-17T14:40:17.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6006fe10 con 0x7f9a6006d0b0 2024-04-17T14:40:17.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.391+0000 7f9a65600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f9a60070a20 con 0x7f9a60158470 2024-04-17T14:40:17.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.435+0000 7f9a5ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9a60151ed0 0x7f9a600c6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43240/0 (socket says 172.21.15.16:43240) 2024-04-17T14:40:17.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.435+0000 7f9a5ea00640 1 -- 172.21.15.16:0/3423171993 learned_addr learned my addr 172.21.15.16:0/3423171993 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:17.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.439+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721929074 0 0) 0x7f9a600c4fa0 con 0x7f9a60151ed0 2024-04-17T14:40:17.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.439+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a44005740 con 0x7f9a60151ed0 2024-04-17T14:40:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 801126777 0 0) 0x7f9a44005740 con 0x7f9a60151ed0 2024-04-17T14:40:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 msgr2=0x7f9a600c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 0x7f9a600c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 >> v1:172.21.15.67:6789/0 conn(0x7f9a6006d0b0 legacy=0x7f9a60157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a600700f0 con 0x7f9a60151ed0 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f9a50001680 con 0x7f9a60151ed0 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 >> v1:172.21.15.16:6789/0 conn(0x7f9a60151ed0 legacy=0x7f9a600c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a44005c00 0x7f9a44006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 0x7f9a44006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a4400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a60070a20 con 0x7f9a44007080 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a440077f0 con 0x7f9a44005c00 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4400e120 con 0x7f9a60158470 2024-04-17T14:40:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.443+0000 7f9a5f400640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a4400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:17.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.447+0000 7f9a5f400640 1 -- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 msgr2=0x7f9a44006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:17.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.447+0000 7f9a5f400640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a60158470 0x7f9a44006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.447+0000 7f9a5f400640 1 -- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a44005c00 msgr2=0x7f9a44006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:17.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.447+0000 7f9a5f400640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a44005c00 0x7f9a44006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.447+0000 7f9a5f400640 1 -- 172.21.15.16:0/3423171993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a44005740 con 0x7f9a44007080 2024-04-17T14:40:17.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.451+0000 7f9a5f400640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a4400dbe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009cd0 tx=0x7f9a5801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beecb21dcf93a7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:17.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a580b2070 con 0x7f9a44007080 2024-04-17T14:40:17.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580a5ca0 con 0x7f9a44007080 2024-04-17T14:40:17.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a5e000640 1 -- 172.21.15.16:0/3423171993 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58006e60 con 0x7f9a44007080 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 -- 172.21.15.16:0/3423171993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 msgr2=0x7f9a4400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 --2- 172.21.15.16:0/3423171993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a4400dbe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009cd0 tx=0x7f9a5801cc70 comp rx=0 tx=0).stop 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a5f400640 1 -- 172.21.15.16:0/3423171993 reap_dead start 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 -- 172.21.15.16:0/3423171993 shutdown_connections 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 -- 172.21.15.16:0/3423171993 >> 172.21.15.16:0/3423171993 conn(0x7f9a600cd410 msgr2=0x7f9a600cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 -- 172.21.15.16:0/3423171993 shutdown_connections 2024-04-17T14:40:17.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.455+0000 7f9a65600640 1 -- 172.21.15.16:0/3423171993 wait complete. 2024-04-17T14:40:17.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 Processor -- start 2024-04-17T14:40:17.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 -- start start 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a601576b0 0x7f9a600cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a6014ba60 0x7f9a600cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600712a0 con 0x7f9a44007080 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600706b0 con 0x7f9a6014ba60 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a65600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600c76f0 con 0x7f9a601576b0 2024-04-17T14:40:17.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a5ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:17.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a5ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33036/0 (socket says 172.21.15.16:33036) 2024-04-17T14:40:17.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.459+0000 7f9a5ea00640 1 -- 172.21.15.16:0/833482404 learned_addr learned my addr 172.21.15.16:0/833482404 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.463+0000 7f9a5ea00640 1 -- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a601576b0 msgr2=0x7f9a600cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.463+0000 7f9a5ea00640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a601576b0 0x7f9a600cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.463+0000 7f9a5ea00640 1 -- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a6014ba60 msgr2=0x7f9a600cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.463+0000 7f9a5ea00640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a6014ba60 0x7f9a600cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.463+0000 7f9a5ea00640 1 -- 172.21.15.16:0/833482404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a60153e80 con 0x7f9a44007080 2024-04-17T14:40:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.467+0000 7f9a5ea00640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c770 tx=0x7f9a5000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:17.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.467+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50018070 con 0x7f9a44007080 2024-04-17T14:40:17.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.467+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a600ca4e0 con 0x7f9a44007080 2024-04-17T14:40:17.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.467+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a60156a40 con 0x7f9a44007080 2024-04-17T14:40:17.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.471+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a60076280 con 0x7f9a44007080 2024-04-17T14:40:17.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.471+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a500074e0 con 0x7f9a44007080 2024-04-17T14:40:17.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.471+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50022060 con 0x7f9a44007080 2024-04-17T14:40:17.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.739+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9a5001b070 con 0x7f9a44007080 2024-04-17T14:40:17.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.739+0000 7f9a57400640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 0x7f9a3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:17.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.743+0000 7f9a56000640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 0x7f9a3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.743+0000 7f9a56000640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 0x7f9a3c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a48007fd0 tx=0x7f9a480079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:17.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.755+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9a50054270 con 0x7f9a44007080 2024-04-17T14:40:17.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.755+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9a500561d0 con 0x7f9a44007080 2024-04-17T14:40:17.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.919+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a60070f80 con 0x7f9a44007080 2024-04-17T14:40:17.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a57400640 1 -- 172.21.15.16:0/833482404 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9a5005a4d0 con 0x7f9a44007080 2024-04-17T14:40:17.924 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 msgr2=0x7f9a3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 0x7f9a3c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a48007fd0 tx=0x7f9a480079a0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 msgr2=0x7f9a60153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c770 tx=0x7f9a5000cc30 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 shutdown_connections 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9a3c068380 0x7f9a3c06a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a6014ba60 0x7f9a600cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a601576b0 0x7f9a600cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 --2- 172.21.15.16:0/833482404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a44007080 0x7f9a60153940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 >> 172.21.15.16:0/833482404 conn(0x7f9a600cd410 msgr2=0x7f9a60147110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 shutdown_connections 2024-04-17T14:40:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:17.927+0000 7f9a65600640 1 -- 172.21.15.16:0/833482404 wait complete. 2024-04-17T14:40:17.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T14:40:18.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 Processor -- start 2024-04-17T14:40:18.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 -- start start 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22a806d5e0 0x7f22a80c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 0x7f22a8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a8073020 con 0x7f22a8151c50 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f22a80c3ac0 con 0x7f22a806d5e0 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.091+0000 7f22aec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f22a8152030 con 0x7f22a80c96a0 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22ad800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f22a8151c50 0x7f22a80722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43256/0 (socket says 172.21.15.16:43256) 2024-04-17T14:40:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22ad800640 1 -- 172.21.15.16:0/3061757337 learned_addr learned my addr 172.21.15.16:0/3061757337 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:18.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22ace00640 1 --2- 172.21.15.16:0/3061757337 >> v2:172.21.15.67:3300/0 conn(0x7f22a806d5e0 0x7f22a80c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22ae200640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 0x7f22a8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098429138 0 0) 0x7f22a8073020 con 0x7f22a8151c50 2024-04-17T14:40:18.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.095+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2290003530 con 0x7f22a8151c50 2024-04-17T14:40:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111996347 0 0) 0x7f2290003530 con 0x7f22a8151c50 2024-04-17T14:40:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 msgr2=0x7f22a8157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 0x7f22a8157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 >> v2:172.21.15.67:3300/0 conn(0x7f22a806d5e0 msgr2=0x7f22a80c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 --2- 172.21.15.16:0/3061757337 >> v2:172.21.15.67:3300/0 conn(0x7f22a806d5e0 0x7f22a80c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a8073300 con 0x7f22a8151c50 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f229c001680 con 0x7f22a8151c50 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 >> v1:172.21.15.16:6789/0 conn(0x7f22a8151c50 legacy=0x7f22a80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 0x7f22900039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290003f90 0x7f2290004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2290004d50 0x7f22900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80c3ac0 con 0x7f2290004d50 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f229000dbe0 con 0x7f2290003f90 2024-04-17T14:40:18.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.099+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f229000dd60 con 0x7f22a80c96a0 2024-04-17T14:40:18.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.103+0000 7f22ae200640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2290004d50 0x7f22900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.107+0000 7f22ae200640 1 -- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 msgr2=0x7f22900039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:18.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.107+0000 7f22ae200640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c96a0 0x7f22900039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.107+0000 7f22ae200640 1 -- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290003f90 msgr2=0x7f2290004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:18.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.107+0000 7f22ae200640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290003f90 0x7f2290004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.107+0000 7f22ae200640 1 -- 172.21.15.16:0/3061757337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2290003530 con 0x7f2290004d50 2024-04-17T14:40:18.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.111+0000 7f22ae200640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2290004d50 0x7f22900051d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22a000e170 tx=0x7f22a001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbc051f42f9f1fe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:18.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00b2070 con 0x7f2290004d50 2024-04-17T14:40:18.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a00a5cb0 con 0x7f2290004d50 2024-04-17T14:40:18.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22a7e00640 1 -- 172.21.15.16:0/3061757337 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0009c10 con 0x7f2290004d50 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- 172.21.15.16:0/3061757337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2290004d50 msgr2=0x7f22900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 --2- 172.21.15.16:0/3061757337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2290004d50 0x7f22900051d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22a000e170 tx=0x7f22a001cca0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22ae200640 1 -- 172.21.15.16:0/3061757337 reap_dead start 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- 172.21.15.16:0/3061757337 shutdown_connections 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- 172.21.15.16:0/3061757337 >> 172.21.15.16:0/3061757337 conn(0x7f22a80c8b80 msgr2=0x7f22a80c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- 172.21.15.16:0/3061757337 shutdown_connections 2024-04-17T14:40:18.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- 172.21.15.16:0/3061757337 wait complete. 2024-04-17T14:40:18.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 Processor -- start 2024-04-17T14:40:18.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 -- start start 2024-04-17T14:40:18.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.115+0000 7f22aec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290004d50 0x7f22a8150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22aec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 0x7f22a8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22aec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 0x7f22a81f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22aec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22a8072dd0 con 0x7f22a8152660 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22aec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80738c0 con 0x7f2290004d50 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22aec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f22a8073ba0 con 0x7f22a80c7760 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22ae200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 0x7f22a81f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22ae200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 0x7f22a81f0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:35048/0 (socket says 172.21.15.16:35048) 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22ace00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 0x7f22a8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.119+0000 7f22ae200640 1 -- 172.21.15.16:0/1994713936 learned_addr learned my addr 172.21.15.16:0/1994713936 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 -- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 msgr2=0x7f22a81f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 0x7f22a81f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ad800640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290004d50 0x7f22a8150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 -- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290004d50 msgr2=0x7f22a8150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290004d50 0x7f22a8150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 -- 172.21.15.16:0/1994713936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a8156520 con 0x7f22a8152660 2024-04-17T14:40:18.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.123+0000 7f22ace00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 0x7f22a8154110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f22a80634d0 tx=0x7f229400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.127+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294017070 con 0x7f22a8152660 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.127+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229400ee40 con 0x7f22a8152660 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.127+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229400cb80 con 0x7f22a8152660 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.127+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a8154b70 con 0x7f22a8152660 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.127+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a8154e30 con 0x7f22a8152660 2024-04-17T14:40:18.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.131+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a80761a0 con 0x7f22a8152660 2024-04-17T14:40:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.151+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f229401a070 con 0x7f22a8152660 2024-04-17T14:40:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.151+0000 7f22a5600640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 0x7f228806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.151+0000 7f22ad800640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 0x7f228806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.151+0000 7f22ad800640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 0x7f228806a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f229c0017f0 tx=0x7f229c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:18.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.415+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2294054f30 con 0x7f22a8152660 2024-04-17T14:40:18.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.415+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2294056e90 con 0x7f22a8152660 2024-04-17T14:40:18.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.587+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22a8071d00 con 0x7f22a8152660 2024-04-17T14:40:18.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22a5600640 1 -- 172.21.15.16:0/1994713936 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f229405b190 con 0x7f22a8152660 2024-04-17T14:40:18.593 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-17T14:40:18.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 msgr2=0x7f228806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 0x7f228806a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f229c0017f0 tx=0x7f229c009040 comp rx=0 tx=0).stop 2024-04-17T14:40:18.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 msgr2=0x7f22a8154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 0x7f22a8154110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f22a80634d0 tx=0x7f229400ec50 comp rx=0 tx=0).stop 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 shutdown_connections 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2288068400 0x7f228806a8c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22a80c7760 0x7f22a81f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22a8152660 0x7f22a8154110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 --2- 172.21.15.16:0/1994713936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2290004d50 0x7f22a8150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 >> 172.21.15.16:0/1994713936 conn(0x7f22a80c8b80 msgr2=0x7f22a80c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 shutdown_connections 2024-04-17T14:40:18.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.595+0000 7f22aec00640 1 -- 172.21.15.16:0/1994713936 wait complete. 2024-04-17T14:40:18.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T14:40:18.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 Processor -- start 2024-04-17T14:40:18.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 -- start start 2024-04-17T14:40:18.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b1c0c3060 0x7f1b1c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1c153430 con 0x7f1b1c0c8d20 2024-04-17T14:40:18.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1c0c3ed0 con 0x7f1b1c153050 2024-04-17T14:40:18.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.759+0000 7f1b24000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1c06ef10 con 0x7f1b1c0c3060 2024-04-17T14:40:18.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.763+0000 7f1b20c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b1c0c3060 0x7f1b1c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.763+0000 7f1b22000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1b1c0c8d20 0x7f1b1c0c7190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43258/0 (socket says 172.21.15.16:43258) 2024-04-17T14:40:18.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.763+0000 7f1b22000640 1 -- 172.21.15.16:0/4186934823 learned_addr learned my addr 172.21.15.16:0/4186934823 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:18.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.767+0000 7f1b20c00640 1 -- 172.21.15.16:0/4186934823 >> v1:172.21.15.67:6789/0 conn(0x7f1b1c153050 legacy=0x7f1b1c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.767+0000 7f1b20c00640 1 -- 172.21.15.16:0/4186934823 >> v1:172.21.15.16:6789/0 conn(0x7f1b1c0c8d20 legacy=0x7f1b1c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.767+0000 7f1b20c00640 1 -- 172.21.15.16:0/4186934823 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c06f160 con 0x7f1b1c0c3060 2024-04-17T14:40:18.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.771+0000 7f1b20c00640 1 --2- 172.21.15.16:0/4186934823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c0c3060 0x7f1b1c0c87e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06f090 tx=0x7f1b0801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba38527d2680dcfc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:18.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b1be00640 1 -- 172.21.15.16:0/4186934823 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b5070 con 0x7f1b1c0c3060 2024-04-17T14:40:18.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b1be00640 1 -- 172.21.15.16:0/4186934823 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b080a8990 con 0x7f1b1c0c3060 2024-04-17T14:40:18.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b1be00640 1 -- 172.21.15.16:0/4186934823 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a8d60 con 0x7f1b1c0c3060 2024-04-17T14:40:18.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 -- 172.21.15.16:0/4186934823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c0c3060 msgr2=0x7f1b1c0c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 --2- 172.21.15.16:0/4186934823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c0c3060 0x7f1b1c0c87e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06f090 tx=0x7f1b0801ec90 comp rx=0 tx=0).stop 2024-04-17T14:40:18.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 -- 172.21.15.16:0/4186934823 shutdown_connections 2024-04-17T14:40:18.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 --2- 172.21.15.16:0/4186934823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c0c3060 0x7f1b1c0c87e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 -- 172.21.15.16:0/4186934823 >> 172.21.15.16:0/4186934823 conn(0x7f1b1c06ba30 msgr2=0x7f1b1c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:18.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 -- 172.21.15.16:0/4186934823 shutdown_connections 2024-04-17T14:40:18.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.775+0000 7f1b24000640 1 -- 172.21.15.16:0/4186934823 wait complete. 2024-04-17T14:40:18.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 Processor -- start 2024-04-17T14:40:18.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 -- start start 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b1c0c3060 0x7f1b1c14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1c0c8d20 0x7f1b1c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c06f720 con 0x7f1b1c153050 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c06ff20 con 0x7f1b1c0c8d20 2024-04-17T14:40:18.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b24000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1c06fa00 con 0x7f1b1c0c3060 2024-04-17T14:40:18.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b22000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b22000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33056/0 (socket says 172.21.15.16:33056) 2024-04-17T14:40:18.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b22000640 1 -- 172.21.15.16:0/4075229994 learned_addr learned my addr 172.21.15.16:0/4075229994 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:18.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b20c00640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1c0c8d20 0x7f1b1c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.779+0000 7f1b21600640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b1c0c3060 0x7f1b1c14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:18.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.783+0000 7f1b22000640 1 -- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b1c0c3060 msgr2=0x7f1b1c14c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.783+0000 7f1b22000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b1c0c3060 0x7f1b1c14c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.783+0000 7f1b22000640 1 -- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1c0c8d20 msgr2=0x7f1b1c149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:18.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.783+0000 7f1b22000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1c0c8d20 0x7f1b1c149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:18.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.783+0000 7f1b22000640 1 -- 172.21.15.16:0/4075229994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c1590c0 con 0x7f1b1c153050 2024-04-17T14:40:18.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.787+0000 7f1b22000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400caf0 tx=0x7f1b1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:18.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.787+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14017070 con 0x7f1b1c153050 2024-04-17T14:40:18.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.787+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1400aca0 con 0x7f1b1c153050 2024-04-17T14:40:18.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.787+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14012600 con 0x7f1b1c153050 2024-04-17T14:40:18.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.787+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c158de0 con 0x7f1b1c153050 2024-04-17T14:40:18.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.791+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c1e5fa0 con 0x7f1b1c153050 2024-04-17T14:40:18.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:18.791+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c076280 con 0x7f1b1c153050 2024-04-17T14:40:19.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.055+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b1401a070 con 0x7f1b1c153050 2024-04-17T14:40:19.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.055+0000 7f1b19600640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 0x7f1afc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.055+0000 7f1b21600640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 0x7f1afc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.055+0000 7f1b21600640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 0x7f1afc06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007fd0 tx=0x7f1b10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:19.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.067+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1b14054b10 con 0x7f1b1c153050 2024-04-17T14:40:19.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.067+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1b14056a70 con 0x7f1b1c153050 2024-04-17T14:40:19.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.235+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b1c150410 con 0x7f1b1c153050 2024-04-17T14:40:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b19600640 1 -- 172.21.15.16:0/4075229994 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f1b1405ad70 con 0x7f1b1c153050 2024-04-17T14:40:19.241 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 msgr2=0x7f1afc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 0x7f1afc06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007fd0 tx=0x7f1b10009040 comp rx=0 tx=0).stop 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 msgr2=0x7f1b1c148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400caf0 tx=0x7f1b1400a060 comp rx=0 tx=0).stop 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 shutdown_connections 2024-04-17T14:40:19.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1afc0683d0 0x7f1afc06a890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c153050 0x7f1b1c148d70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b1c0c8d20 0x7f1b1c149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 --2- 172.21.15.16:0/4075229994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b1c0c3060 0x7f1b1c14c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 >> 172.21.15.16:0/4075229994 conn(0x7f1b1c06ba30 msgr2=0x7f1b1c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 shutdown_connections 2024-04-17T14:40:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.243+0000 7f1b24000640 1 -- 172.21.15.16:0/4075229994 wait complete. 2024-04-17T14:40:19.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:40:19.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 Processor -- start 2024-04-17T14:40:19.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 -- start start 2024-04-17T14:40:19.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 0x7fa0c015c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c006e400 con 0x7fa0c0152ec0 2024-04-17T14:40:19.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c00c8ea0 con 0x7fa0c00ca2b0 2024-04-17T14:40:19.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.403+0000 7fa0c8400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c006e1d0 con 0x7fa0c00c5420 2024-04-17T14:40:19.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.407+0000 7fa0c5a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa0c0152ec0 0x7fa0c00c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43266/0 (socket says 172.21.15.16:43266) 2024-04-17T14:40:19.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.407+0000 7fa0c5a00640 1 -- 172.21.15.16:0/3374967387 learned_addr learned my addr 172.21.15.16:0/3374967387 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:19.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.407+0000 7fa0c5000640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 0x7fa0c015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.407+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020217236 0 0) 0x7fa0c006e400 con 0x7fa0c0152ec0 2024-04-17T14:40:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.407+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a8003530 con 0x7fa0c0152ec0 2024-04-17T14:40:19.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1973184633 0 0) 0x7fa0a8003530 con 0x7fa0c0152ec0 2024-04-17T14:40:19.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 msgr2=0x7fa0c015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 0x7fa0c015c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 >> v1:172.21.15.67:6789/0 conn(0x7fa0c00ca2b0 legacy=0x7fa0c01634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c00c9160 con 0x7fa0c0152ec0 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7fa0b4001680 con 0x7fa0c0152ec0 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 >> v1:172.21.15.16:6789/0 conn(0x7fa0c0152ec0 legacy=0x7fa0c00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 0x7fa0a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a800bb10 con 0x7fa0a80039f0 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a800bcc0 con 0x7fa0a8004810 2024-04-17T14:40:19.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.411+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a800bec0 con 0x7fa0c00c5420 2024-04-17T14:40:19.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.415+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.419+0000 7fa0c5a00640 1 -- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 msgr2=0x7fa0a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:19.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.419+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c00c5420 0x7fa0a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.419+0000 7fa0c5a00640 1 -- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a8004810 msgr2=0x7fa0a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:19.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.419+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.419+0000 7fa0c5a00640 1 -- 172.21.15.16:0/3374967387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8003530 con 0x7fa0a80039f0 2024-04-17T14:40:19.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.423+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0a8003e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c160 tx=0x7fa0b401f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f27082dfa794f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007c70 con 0x7fa0a80039f0 2024-04-17T14:40:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005ae0 con 0x7fa0a80039f0 2024-04-17T14:40:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0bfe00640 1 -- 172.21.15.16:0/3374967387 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007070 con 0x7fa0a80039f0 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- 172.21.15.16:0/3374967387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 msgr2=0x7fa0a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 --2- 172.21.15.16:0/3374967387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0a8003e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c160 tx=0x7fa0b401f2f0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c6400640 1 -- 172.21.15.16:0/3374967387 reap_dead start 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- 172.21.15.16:0/3374967387 shutdown_connections 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- 172.21.15.16:0/3374967387 >> 172.21.15.16:0/3374967387 conn(0x7fa0c0062850 msgr2=0x7fa0c006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- 172.21.15.16:0/3374967387 shutdown_connections 2024-04-17T14:40:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- 172.21.15.16:0/3374967387 wait complete. 2024-04-17T14:40:19.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 Processor -- start 2024-04-17T14:40:19.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.427+0000 7fa0c8400640 1 -- start start 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c015ba40 0x7fa0c006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0c00c5f80 0x7fa0c00c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0158e90 con 0x7fa0a80039f0 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01532a0 con 0x7fa0c00c5f80 2024-04-17T14:40:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c8400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c0159170 con 0x7fa0c015ba40 2024-04-17T14:40:19.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c5a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c5a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33076/0 (socket says 172.21.15.16:33076) 2024-04-17T14:40:19.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c5a00640 1 -- 172.21.15.16:0/2943150596 learned_addr learned my addr 172.21.15.16:0/2943150596 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:19.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c5000640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c015ba40 0x7fa0c006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.431+0000 7fa0c6400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0c00c5f80 0x7fa0c00c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 -- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c015ba40 msgr2=0x7fa0c006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c015ba40 0x7fa0c006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 -- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0c00c5f80 msgr2=0x7fa0c00c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0c00c5f80 0x7fa0c00c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 -- 172.21.15.16:0/2943150596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01e49d0 con 0x7fa0a80039f0 2024-04-17T14:40:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.435+0000 7fa0c5a00640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c160 tx=0x7fa0a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.439+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40047f0 con 0x7fa0a80039f0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.439+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4004990 con 0x7fa0a80039f0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.439+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4004d60 con 0x7fa0a80039f0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.439+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01e4cb0 con 0x7fa0a80039f0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.439+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c00c86d0 con 0x7fa0a80039f0 2024-04-17T14:40:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.443+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c00c88a0 con 0x7fa0a80039f0 2024-04-17T14:40:19.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.463+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0b40c2060 con 0x7fa0a80039f0 2024-04-17T14:40:19.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.463+0000 7fa0bd600640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 0x7fa0a006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:19.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.463+0000 7fa0c5000640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 0x7fa0a006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:19.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.467+0000 7fa0c5000640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 0x7fa0a006a8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00c4e50 tx=0x7fa0ac009570 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:19.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.467+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa0b4007700 con 0x7fa0a80039f0 2024-04-17T14:40:19.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.727+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa0b40ca080 con 0x7fa0a80039f0 2024-04-17T14:40:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.931+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0c0076280 con 0x7fa0a80039f0 2024-04-17T14:40:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0bd600640 1 -- 172.21.15.16:0/2943150596 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7fa0b40b6040 con 0x7fa0a80039f0 2024-04-17T14:40:19.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:19.973 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T14:40:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 msgr2=0x7fa0a006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 0x7fa0a006a8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00c4e50 tx=0x7fa0ac009570 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 msgr2=0x7fa0c01f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c160 tx=0x7fa0a8005840 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 shutdown_connections 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa0a0068400 0x7fa0a006a8c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0c00c5f80 0x7fa0c00c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0c015ba40 0x7fa0c006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 --2- 172.21.15.16:0/2943150596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80039f0 0x7fa0c01f1060 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 >> 172.21.15.16:0/2943150596 conn(0x7fa0c0062850 msgr2=0x7fa0c015c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 shutdown_connections 2024-04-17T14:40:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:19.975+0000 7fa0c8400640 1 -- 172.21.15.16:0/2943150596 wait complete. 2024-04-17T14:40:19.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:20.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.135+0000 7fd15ce00640 1 Processor -- start 2024-04-17T14:40:20.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.135+0000 7fd15ce00640 1 -- start start 2024-04-17T14:40:20.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd15ce00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd158151db0 0x7fd1580c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd15ce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd15815be40 0x7fd158157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd15ce00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd158158610 con 0x7fd158158110 2024-04-17T14:40:20.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd15ce00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd1580c8be0 con 0x7fd15815be40 2024-04-17T14:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd15ce00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd158071b30 con 0x7fd158151db0 2024-04-17T14:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd15815be40 0x7fd158157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd15815be40 0x7fd158157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33086/0 (socket says 172.21.15.16:33086) 2024-04-17T14:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 -- 172.21.15.16:0/2600757757 learned_addr learned my addr 172.21.15.16:0/2600757757 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:20.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd155e00640 1 --2- 172.21.15.16:0/2600757757 >> v2:172.21.15.67:3300/0 conn(0x7fd158151db0 0x7fd1580c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 -- 172.21.15.16:0/2600757757 >> v2:172.21.15.67:3300/0 conn(0x7fd158151db0 msgr2=0x7fd1580c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:20.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 --2- 172.21.15.16:0/2600757757 >> v2:172.21.15.67:3300/0 conn(0x7fd158151db0 0x7fd1580c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 -- 172.21.15.16:0/2600757757 >> v1:172.21.15.67:6789/0 conn(0x7fd158158110 legacy=0x7fd1580c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:20.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.139+0000 7fd14fe00640 1 -- 172.21.15.16:0/2600757757 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1581588f0 con 0x7fd15815be40 2024-04-17T14:40:20.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.143+0000 7fd14fe00640 1 --2- 172.21.15.16:0/2600757757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15815be40 0x7fd158157bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd158070020 tx=0x7fd14001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c200745c4fcb3cd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.147+0000 7fd155400640 1 -- 172.21.15.16:0/2600757757 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1400b5070 con 0x7fd15815be40 2024-04-17T14:40:20.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.147+0000 7fd155400640 1 -- 172.21.15.16:0/2600757757 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1400a89d0 con 0x7fd15815be40 2024-04-17T14:40:20.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.147+0000 7fd155400640 1 -- 172.21.15.16:0/2600757757 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1400a8da0 con 0x7fd15815be40 2024-04-17T14:40:20.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- 172.21.15.16:0/2600757757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15815be40 msgr2=0x7fd158157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- 172.21.15.16:0/2600757757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15815be40 0x7fd158157bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd158070020 tx=0x7fd14001ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- 172.21.15.16:0/2600757757 shutdown_connections 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- 172.21.15.16:0/2600757757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15815be40 0x7fd158157bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- 172.21.15.16:0/2600757757 >> v2:172.21.15.67:3300/0 conn(0x7fd158151db0 0x7fd1580c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- 172.21.15.16:0/2600757757 >> 172.21.15.16:0/2600757757 conn(0x7fd15806ba30 msgr2=0x7fd15806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- 172.21.15.16:0/2600757757 shutdown_connections 2024-04-17T14:40:20.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- 172.21.15.16:0/2600757757 wait complete. 2024-04-17T14:40:20.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 Processor -- start 2024-04-17T14:40:20.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- start start 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd158151db0 0x7fd158140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815be40 0x7fd15813e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd15815b920 con 0x7fd158158110 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd15815b640 con 0x7fd15815be40 2024-04-17T14:40:20.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd15ce00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd1580c4080 con 0x7fd158151db0 2024-04-17T14:40:20.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33090/0 (socket says 172.21.15.16:33090) 2024-04-17T14:40:20.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.151+0000 7fd14fe00640 1 -- 172.21.15.16:0/3045145331 learned_addr learned my addr 172.21.15.16:0/3045145331 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:20.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd155e00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd158151db0 0x7fd158140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd156800640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815be40 0x7fd15813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd14fe00640 1 -- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd158151db0 msgr2=0x7fd158140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd14fe00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd158151db0 0x7fd158140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd14fe00640 1 -- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815be40 msgr2=0x7fd15813e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd14fe00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815be40 0x7fd15813e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.155+0000 7fd14fe00640 1 -- 172.21.15.16:0/3045145331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15815a4d0 con 0x7fd158158110 2024-04-17T14:40:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.159+0000 7fd14fe00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd14001d380 tx=0x7fd14001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1400b5070 con 0x7fd158158110 2024-04-17T14:40:20.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1400bf070 con 0x7fd158158110 2024-04-17T14:40:20.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1400b0c50 con 0x7fd158158110 2024-04-17T14:40:20.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd158158f10 con 0x7fd158158110 2024-04-17T14:40:20.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1581594d0 con 0x7fd158158110 2024-04-17T14:40:20.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.163+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd158076280 con 0x7fd158158110 2024-04-17T14:40:20.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.183+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1400ba440 con 0x7fd158158110 2024-04-17T14:40:20.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.187+0000 7fd14e000640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 0x7fd13406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.187+0000 7fd155e00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 0x7fd13406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.187+0000 7fd155e00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 0x7fd13406a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd1480079c0 tx=0x7fd148008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.443+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd1400bbe00 con 0x7fd158158110 2024-04-17T14:40:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.443+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd140018830 con 0x7fd158158110 2024-04-17T14:40:20.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.611+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1580c4400 con 0x7fd158158110 2024-04-17T14:40:20.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd14e000640 1 -- 172.21.15.16:0/3045145331 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7fd1400f4950 con 0x7fd158158110 2024-04-17T14:40:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:20.649 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 msgr2=0x7fd13406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 0x7fd13406a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd1480079c0 tx=0x7fd148008040 comp rx=0 tx=0).stop 2024-04-17T14:40:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 msgr2=0x7fd1581415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd14001d380 tx=0x7fd14001ba70 comp rx=0 tx=0).stop 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 shutdown_connections 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd1340683d0 0x7fd13406a890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd15815be40 0x7fd15813e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd158158110 0x7fd1581415c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 --2- 172.21.15.16:0/3045145331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd158151db0 0x7fd158140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 >> 172.21.15.16:0/3045145331 conn(0x7fd15806ba30 msgr2=0x7fd1580c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 shutdown_connections 2024-04-17T14:40:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.651+0000 7fd15ce00640 1 -- 172.21.15.16:0/3045145331 wait complete. 2024-04-17T14:40:20.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T14:39:17.815818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T14:39:56.221860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T14:39:57.848198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T14:40:20.671 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T14:40:20.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.815+0000 7f9668000640 1 Processor -- start 2024-04-17T14:40:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.815+0000 7f9668000640 1 -- start start 2024-04-17T14:40:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9668000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 0x7f96600c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9668000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9660158610 con 0x7f966015be40 2024-04-17T14:40:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9668000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96601588f0 con 0x7f9660151db0 2024-04-17T14:40:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9668000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f96600c8be0 con 0x7f96600c5a20 2024-04-17T14:40:20.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9666000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 0x7f96600c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9664c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f966015be40 0x7f96600c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43270/0 (socket says 172.21.15.16:43270) 2024-04-17T14:40:20.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.819+0000 7f9664c00640 1 -- 172.21.15.16:0/1558840247 learned_addr learned my addr 172.21.15.16:0/1558840247 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.823+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747044170 0 0) 0x7f9660158610 con 0x7f966015be40 2024-04-17T14:40:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.823+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9648003530 con 0x7f966015be40 2024-04-17T14:40:20.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209035238 0 0) 0x7f9648003530 con 0x7f966015be40 2024-04-17T14:40:20.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 msgr2=0x7f96600c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 0x7f96600c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 >> v1:172.21.15.67:6789/0 conn(0x7f9660151db0 legacy=0x7f9660157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966015b360 con 0x7f966015be40 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f964c001680 con 0x7f966015be40 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 >> v1:172.21.15.16:6789/0 conn(0x7f966015be40 legacy=0x7f96600c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96480039f0 0x7f9648003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9648004810 0x7f9648004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 0x7f96480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f964800bb40 con 0x7f96480039f0 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f964800bcf0 con 0x7f9648004810 2024-04-17T14:40:20.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.827+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f964800bef0 con 0x7f96600c5a20 2024-04-17T14:40:20.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96480039f0 0x7f9648003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9664c00640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9648004810 0x7f9648004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 -- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 msgr2=0x7f96480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96600c5a20 0x7f96480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 -- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9648004810 msgr2=0x7f9648004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9648004810 0x7f9648004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.831+0000 7f9665600640 1 -- 172.21.15.16:0/1558840247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9648003530 con 0x7f96480039f0 2024-04-17T14:40:20.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.835+0000 7f9665600640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96480039f0 0x7f9648003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9654001750 tx=0x7f965401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1028fc2824e1adca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540013a0 con 0x7f96480039f0 2024-04-17T14:40:20.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96540052f0 con 0x7f96480039f0 2024-04-17T14:40:20.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f965fe00640 1 -- 172.21.15.16:0/1558840247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654003840 con 0x7f96480039f0 2024-04-17T14:40:20.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f9668000640 1 -- 172.21.15.16:0/1558840247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96480039f0 msgr2=0x7f9648003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f9668000640 1 --2- 172.21.15.16:0/1558840247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96480039f0 0x7f9648003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9654001750 tx=0x7f965401c3c0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.839+0000 7f9666000640 1 -- 172.21.15.16:0/1558840247 reap_dead start 2024-04-17T14:40:20.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- 172.21.15.16:0/1558840247 shutdown_connections 2024-04-17T14:40:20.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- 172.21.15.16:0/1558840247 >> 172.21.15.16:0/1558840247 conn(0x7f966006ba30 msgr2=0x7f966006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:20.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- 172.21.15.16:0/1558840247 shutdown_connections 2024-04-17T14:40:20.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- 172.21.15.16:0/1558840247 wait complete. 2024-04-17T14:40:20.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 Processor -- start 2024-04-17T14:40:20.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- start start 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96480039f0 0x7f9660155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96601f26a0 0x7f96601f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f966015b920 con 0x7f9660154ae0 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9660071b30 con 0x7f96601f26a0 2024-04-17T14:40:20.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9668000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f96601582e0 con 0x7f96480039f0 2024-04-17T14:40:20.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9664c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9664c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33104/0 (socket says 172.21.15.16:33104) 2024-04-17T14:40:20.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.843+0000 7f9664c00640 1 -- 172.21.15.16:0/3223770526 learned_addr learned my addr 172.21.15.16:0/3223770526 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9665600640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96480039f0 0x7f9660155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9666000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96601f26a0 0x7f96601f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9664c00640 1 -- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96480039f0 msgr2=0x7f9660155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9664c00640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96480039f0 0x7f9660155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9664c00640 1 -- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96601f26a0 msgr2=0x7f96601f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9664c00640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96601f26a0 0x7f96601f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.847+0000 7f9664c00640 1 -- 172.21.15.16:0/3223770526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96601474d0 con 0x7f9660154ae0 2024-04-17T14:40:20.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.851+0000 7f9664c00640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f964c010c00 tx=0x7f964c005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c01b070 con 0x7f9660154ae0 2024-04-17T14:40:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c011040 con 0x7f9660154ae0 2024-04-17T14:40:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0143a0 con 0x7f9660154ae0 2024-04-17T14:40:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96601efa60 con 0x7f9660154ae0 2024-04-17T14:40:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601eeee0 con 0x7f9660154ae0 2024-04-17T14:40:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.855+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660076280 con 0x7f9660154ae0 2024-04-17T14:40:20.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.875+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f964c01e070 con 0x7f9660154ae0 2024-04-17T14:40:20.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.875+0000 7f965d600640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 0x7f964006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:20.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.875+0000 7f9665600640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 0x7f964006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.879+0000 7f9665600640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 0x7f964006a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96480057f0 tx=0x7f96540011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:20.879+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f964c057930 con 0x7f9660154ae0 2024-04-17T14:40:21.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.135+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f964c059890 con 0x7f9660154ae0 2024-04-17T14:40:21.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.319+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96601ef1c0 con 0x7f9660154ae0 2024-04-17T14:40:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f965d600640 1 -- 172.21.15.16:0/3223770526 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f964c05db90 con 0x7f9660154ae0 2024-04-17T14:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 msgr2=0x7f964006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 0x7f964006a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96480057f0 tx=0x7f96540011a0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 msgr2=0x7f96601e1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f964c010c00 tx=0x7f964c005860 comp rx=0 tx=0).stop 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 shutdown_connections 2024-04-17T14:40:21.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9640068400 0x7f964006a8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96601f26a0 0x7f96601f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9660154ae0 0x7f96601e1280 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 --2- 172.21.15.16:0/3223770526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96480039f0 0x7f9660155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 >> 172.21.15.16:0/3223770526 conn(0x7f966006ba30 msgr2=0x7f966014f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 shutdown_connections 2024-04-17T14:40:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.367+0000 7f9668000640 1 -- 172.21.15.16:0/3223770526 wait complete. 2024-04-17T14:40:21.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T14:40:21.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 Processor -- start 2024-04-17T14:40:21.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 -- start start 2024-04-17T14:40:21.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc154f30 0x7fd0dc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd0dc072ac0 0x7fd0dc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc15bbf0 con 0x7fd0dc06f520 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd0dc155310 con 0x7fd0dc072ac0 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.531+0000 7fd0e2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd0dc0c8d30 con 0x7fd0dc154f30 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.535+0000 7fd0d3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd0dc072ac0 0x7fd0dc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.535+0000 7fd0dbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd0dc06f520 0x7fd0dc06f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37812/0 (socket says 172.21.15.16:37812) 2024-04-17T14:40:21.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.535+0000 7fd0dbe00640 1 -- 172.21.15.16:0/3137966186 learned_addr learned my addr 172.21.15.16:0/3137966186 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:21.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.535+0000 7fd0db400640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc154f30 0x7fd0dc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.539+0000 7fd0d3e00640 1 -- 172.21.15.16:0/3137966186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc154f30 msgr2=0x7fd0dc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:21.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.539+0000 7fd0d3e00640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc154f30 0x7fd0dc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.539+0000 7fd0d3e00640 1 -- 172.21.15.16:0/3137966186 >> v1:172.21.15.16:6789/0 conn(0x7fd0dc06f520 legacy=0x7fd0dc06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.539+0000 7fd0d3e00640 1 -- 172.21.15.16:0/3137966186 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc0c9010 con 0x7fd0dc072ac0 2024-04-17T14:40:21.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.539+0000 7fd0d3e00640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc072ee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097c0 tx=0x7fd0c401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0666e73e85aaad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:21.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.543+0000 7fd0daa00640 1 -- 172.21.15.16:0/3137966186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40b5070 con 0x7fd0dc072ac0 2024-04-17T14:40:21.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.543+0000 7fd0daa00640 1 -- 172.21.15.16:0/3137966186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c40a8990 con 0x7fd0dc072ac0 2024-04-17T14:40:21.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.543+0000 7fd0daa00640 1 -- 172.21.15.16:0/3137966186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40a8d60 con 0x7fd0dc072ac0 2024-04-17T14:40:21.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- 172.21.15.16:0/3137966186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc072ac0 msgr2=0x7fd0dc072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc072ee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097c0 tx=0x7fd0c401ec90 comp rx=0 tx=0).stop 2024-04-17T14:40:21.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- 172.21.15.16:0/3137966186 shutdown_connections 2024-04-17T14:40:21.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc072ee0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3137966186 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc154f30 0x7fd0dc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- 172.21.15.16:0/3137966186 >> 172.21.15.16:0/3137966186 conn(0x7fd0dc06ba30 msgr2=0x7fd0dc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- 172.21.15.16:0/3137966186 shutdown_connections 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- 172.21.15.16:0/3137966186 wait complete. 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 Processor -- start 2024-04-17T14:40:21.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- start start 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc06f520 0x7fd0dc1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc1f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc0c98b0 con 0x7fd0dc154f30 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc0c95d0 con 0x7fd0dc072ac0 2024-04-17T14:40:21.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0e2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fd0dc073420 con 0x7fd0dc06f520 2024-04-17T14:40:21.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.547+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33240/0 (socket says 172.21.15.16:33240) 2024-04-17T14:40:21.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 -- 172.21.15.16:0/3598258608 learned_addr learned my addr 172.21.15.16:0/3598258608 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:21.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0d3e00640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc1f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0db400640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc06f520 0x7fd0dc1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 -- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc06f520 msgr2=0x7fd0dc1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc06f520 0x7fd0dc1f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 -- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0dc072ac0 msgr2=0x7fd0dc1f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:21.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc1f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:21.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.551+0000 7fd0dbe00640 1 -- 172.21.15.16:0/3598258608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc150210 con 0x7fd0dc154f30 2024-04-17T14:40:21.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.555+0000 7fd0dbe00640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400cbf0 tx=0x7fd0d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:21.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4017070 con 0x7fd0dc154f30 2024-04-17T14:40:21.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d400ad40 con 0x7fd0dc154f30 2024-04-17T14:40:21.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4012600 con 0x7fd0dc154f30 2024-04-17T14:40:21.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1f42f0 con 0x7fd0dc154f30 2024-04-17T14:40:21.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc153de0 con 0x7fd0dc154f30 2024-04-17T14:40:21.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.559+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc076280 con 0x7fd0dc154f30 2024-04-17T14:40:21.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.579+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0d401a070 con 0x7fd0dc154f30 2024-04-17T14:40:21.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.579+0000 7fd0d3400640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 0x7fd0b806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:21.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.583+0000 7fd0db400640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 0x7fd0b806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:21.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.583+0000 7fd0db400640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 0x7fd0b806a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0079c0 tx=0x7fd0cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:21.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.835+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd0d4054b20 con 0x7fd0dc154f30 2024-04-17T14:40:21.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:21.839+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd0d4056a80 con 0x7fd0dc154f30 2024-04-17T14:40:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.003+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd0dc06ca40 con 0x7fd0dc154f30 2024-04-17T14:40:22.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.007+0000 7fd0d3400640 1 -- 172.21.15.16:0/3598258608 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fd0d405ad80 con 0x7fd0dc154f30 2024-04-17T14:40:22.007 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 msgr2=0x7fd0b806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 0x7fd0b806a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0079c0 tx=0x7fd0cc008040 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 msgr2=0x7fd0dc1f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400cbf0 tx=0x7fd0d400a430 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 shutdown_connections 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fd0b80683d0 0x7fd0b806a890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0dc154f30 0x7fd0dc1f24a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0dc072ac0 0x7fd0dc1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 --2- 172.21.15.16:0/3598258608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd0dc06f520 0x7fd0dc1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 >> 172.21.15.16:0/3598258608 conn(0x7fd0dc06ba30 msgr2=0x7fd0dc15a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 shutdown_connections 2024-04-17T14:40:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.011+0000 7fd0e2600640 1 -- 172.21.15.16:0/3598258608 wait complete. 2024-04-17T14:40:22.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T14:40:22.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 Processor -- start 2024-04-17T14:40:22.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 -- start start 2024-04-17T14:40:22.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2094152f50 0x7f20940c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2094071760 0x7f2094071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2094153330 con 0x7f20940c90b0 2024-04-17T14:40:22.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2094072110 con 0x7f2094152f50 2024-04-17T14:40:22.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f209ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f209415c2b0 con 0x7f2094071760 2024-04-17T14:40:22.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f208b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f20940c90b0 0x7f20940c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37816/0 (socket says 172.21.15.16:37816) 2024-04-17T14:40:22.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f208b400640 1 -- 172.21.15.16:0/1898915507 learned_addr learned my addr 172.21.15.16:0/1898915507 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:22.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f2093e00640 1 --2- 172.21.15.16:0/1898915507 >> v2:172.21.15.67:3300/0 conn(0x7f2094152f50 0x7f20940c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.175+0000 7f2098e00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2094071760 0x7f2094071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.179+0000 7f2093400640 1 -- 172.21.15.16:0/1898915507 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140481603 0 0) 0x7f2094153330 con 0x7f20940c90b0 2024-04-17T14:40:22.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.179+0000 7f2093400640 1 -- 172.21.15.16:0/1898915507 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2078003530 con 0x7f20940c90b0 2024-04-17T14:40:22.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.183+0000 7f2093e00640 1 -- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2094071760 msgr2=0x7f2094071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:22.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.183+0000 7f2093e00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2094071760 0x7f2094071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.183+0000 7f2093e00640 1 -- 172.21.15.16:0/1898915507 >> v1:172.21.15.16:6789/0 conn(0x7f20940c90b0 legacy=0x7f20940c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.183+0000 7f2093e00640 1 -- 172.21.15.16:0/1898915507 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209415c590 con 0x7f2094152f50 2024-04-17T14:40:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.191+0000 7f2093e00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094152f50 0x7f20940c5570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2084009d90 tx=0x7f208401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228205d10290481c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.195+0000 7f2093400640 1 -- 172.21.15.16:0/1898915507 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840b2070 con 0x7f2094152f50 2024-04-17T14:40:22.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.199+0000 7f2093400640 1 -- 172.21.15.16:0/1898915507 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20840a5800 con 0x7f2094152f50 2024-04-17T14:40:22.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094152f50 msgr2=0x7f20940c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094152f50 0x7f20940c5570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2084009d90 tx=0x7f208401c850 comp rx=0 tx=0).stop 2024-04-17T14:40:22.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- 172.21.15.16:0/1898915507 shutdown_connections 2024-04-17T14:40:22.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2094071760 0x7f2094071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- 172.21.15.16:0/1898915507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094152f50 0x7f20940c5570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- 172.21.15.16:0/1898915507 >> 172.21.15.16:0/1898915507 conn(0x7f209406dc40 msgr2=0x7f209406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:22.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- 172.21.15.16:0/1898915507 shutdown_connections 2024-04-17T14:40:22.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- 172.21.15.16:0/1898915507 wait complete. 2024-04-17T14:40:22.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 Processor -- start 2024-04-17T14:40:22.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- start start 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094071760 0x7f20941f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20940c90b0 0x7f209413e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20940c3de0 con 0x7f2094152f50 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20940c9490 con 0x7f2094071760 2024-04-17T14:40:22.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f209ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20940c3f60 con 0x7f20940c90b0 2024-04-17T14:40:22.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f2098e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.203+0000 7f2098e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33242/0 (socket says 172.21.15.16:33242) 2024-04-17T14:40:22.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 -- 172.21.15.16:0/2759038386 learned_addr learned my addr 172.21.15.16:0/2759038386 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:22.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f208b400640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20940c90b0 0x7f209413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2093e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094071760 0x7f20941f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 -- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20940c90b0 msgr2=0x7f209413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20940c90b0 0x7f209413e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 -- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094071760 msgr2=0x7f20941f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094071760 0x7f20941f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.207+0000 7f2098e00640 1 -- 172.21.15.16:0/2759038386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209413e790 con 0x7f2094152f50 2024-04-17T14:40:22.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.211+0000 7f2098e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e7f0 tx=0x7f208c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c017070 con 0x7f2094152f50 2024-04-17T14:40:22.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c00c940 con 0x7f2094152f50 2024-04-17T14:40:22.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00eea0 con 0x7f2094152f50 2024-04-17T14:40:22.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2094142680 con 0x7f2094152f50 2024-04-17T14:40:22.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2094142c40 con 0x7f2094152f50 2024-04-17T14:40:22.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.215+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2094076280 con 0x7f2094152f50 2024-04-17T14:40:22.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.235+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f208c01a070 con 0x7f2094152f50 2024-04-17T14:40:22.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.235+0000 7f2090c00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 0x7f207006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.235+0000 7f2093e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 0x7f207006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.239+0000 7f2093e00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 0x7f207006a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20840af000 tx=0x7f20840a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.239+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f208c054f50 con 0x7f2094152f50 2024-04-17T14:40:22.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.499+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f208c056eb0 con 0x7f2094152f50 2024-04-17T14:40:22.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.679+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f209414cfe0 con 0x7f2094152f50 2024-04-17T14:40:22.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.687+0000 7f2090c00640 1 -- 172.21.15.16:0/2759038386 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f208c05b1b0 con 0x7f2094152f50 2024-04-17T14:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-17T14:40:22.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 msgr2=0x7f207006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 0x7f207006a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20840af000 tx=0x7f20840a7070 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 msgr2=0x7f20941410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e7f0 tx=0x7f208c00ecb0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 shutdown_connections 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20700683d0 0x7f207006a890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2094152f50 0x7f20941410d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20940c90b0 0x7f209413e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 --2- 172.21.15.16:0/2759038386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094071760 0x7f20941f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 >> 172.21.15.16:0/2759038386 conn(0x7f209406dc40 msgr2=0x7f209414d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 shutdown_connections 2024-04-17T14:40:22.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.691+0000 7f209ae00640 1 -- 172.21.15.16:0/2759038386 wait complete. 2024-04-17T14:40:22.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:40:22.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.847+0000 7f68aa600640 1 Processor -- start 2024-04-17T14:40:22.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.847+0000 7f68aa600640 1 -- start start 2024-04-17T14:40:22.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68aa600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f68a4151db0 0x7f68a40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68aa600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a40c5a20 0x7f68a40c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68aa600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a4158610 con 0x7f68a415be40 2024-04-17T14:40:22.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68aa600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f68a40c8be0 con 0x7f68a40c5a20 2024-04-17T14:40:22.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68aa600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f68a4071b30 con 0x7f68a4151db0 2024-04-17T14:40:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68a3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a40c5a20 0x7f68a40c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68a3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a40c5a20 0x7f68a40c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33256/0 (socket says 172.21.15.16:33256) 2024-04-17T14:40:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68a3e00640 1 -- 172.21.15.16:0/3771881029 learned_addr learned my addr 172.21.15.16:0/3771881029 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.851+0000 7f68a3400640 1 --2- 172.21.15.16:0/3771881029 >> v2:172.21.15.67:3300/0 conn(0x7f68a4151db0 0x7f68a40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.855+0000 7f68a3e00640 1 -- 172.21.15.16:0/3771881029 >> v2:172.21.15.67:3300/0 conn(0x7f68a4151db0 msgr2=0x7f68a40c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:22.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.855+0000 7f68a3e00640 1 --2- 172.21.15.16:0/3771881029 >> v2:172.21.15.67:3300/0 conn(0x7f68a4151db0 0x7f68a40c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.855+0000 7f68a3e00640 1 -- 172.21.15.16:0/3771881029 >> v1:172.21.15.67:6789/0 conn(0x7f68a415be40 legacy=0x7f68a4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:22.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.855+0000 7f68a3e00640 1 -- 172.21.15.16:0/3771881029 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a41588f0 con 0x7f68a40c5a20 2024-04-17T14:40:22.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.859+0000 7f68a3e00640 1 --2- 172.21.15.16:0/3771881029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a40c5a20 0x7f68a40c3970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68a4070020 tx=0x7f689c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84b0be08cc910ce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.859+0000 7f68a2a00640 1 -- 172.21.15.16:0/3771881029 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0b5070 con 0x7f68a40c5a20 2024-04-17T14:40:22.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68a2a00640 1 -- 172.21.15.16:0/3771881029 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c0a89d0 con 0x7f68a40c5a20 2024-04-17T14:40:22.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68a2a00640 1 -- 172.21.15.16:0/3771881029 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0a8da0 con 0x7f68a40c5a20 2024-04-17T14:40:22.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- 172.21.15.16:0/3771881029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a40c5a20 msgr2=0x7f68a40c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 --2- 172.21.15.16:0/3771881029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a40c5a20 0x7f68a40c3970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68a4070020 tx=0x7f689c01ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- 172.21.15.16:0/3771881029 shutdown_connections 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 --2- 172.21.15.16:0/3771881029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a40c5a20 0x7f68a40c3970 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 --2- 172.21.15.16:0/3771881029 >> v2:172.21.15.67:3300/0 conn(0x7f68a4151db0 0x7f68a40c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- 172.21.15.16:0/3771881029 >> 172.21.15.16:0/3771881029 conn(0x7f68a406ba30 msgr2=0x7f68a406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- 172.21.15.16:0/3771881029 shutdown_connections 2024-04-17T14:40:22.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- 172.21.15.16:0/3771881029 wait complete. 2024-04-17T14:40:22.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 Processor -- start 2024-04-17T14:40:22.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.863+0000 7f68aa600640 1 -- start start 2024-04-17T14:40:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68a40c5a20 0x7f68a4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68a4151db0 0x7f68a414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f68a415b920 con 0x7f68a415be40 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f68a415b640 con 0x7f68a4151db0 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68aa600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f68a41582e0 con 0x7f68a40c5a20 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68a3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68a3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33258/0 (socket says 172.21.15.16:33258) 2024-04-17T14:40:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68a3e00640 1 -- 172.21.15.16:0/3299890352 learned_addr learned my addr 172.21.15.16:0/3299890352 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f68a3400640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68a40c5a20 0x7f68a4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.867+0000 7f689aa00640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68a4151db0 0x7f68a414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 -- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68a40c5a20 msgr2=0x7f68a4156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68a40c5a20 0x7f68a4156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 -- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68a4151db0 msgr2=0x7f68a414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:22.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68a4151db0 0x7f68a414bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:22.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 -- 172.21.15.16:0/3299890352 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a4156270 con 0x7f68a415be40 2024-04-17T14:40:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.871+0000 7f68a3e00640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f689c01c900 tx=0x7f689c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0b5070 con 0x7f68a415be40 2024-04-17T14:40:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c0b0ab0 con 0x7f68a415be40 2024-04-17T14:40:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0bb410 con 0x7f68a415be40 2024-04-17T14:40:22.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a41578e0 con 0x7f68a415be40 2024-04-17T14:40:22.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41567c0 con 0x7f68a415be40 2024-04-17T14:40:22.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.875+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a4076280 con 0x7f68a415be40 2024-04-17T14:40:22.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.895+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f689c0c2060 con 0x7f68a415be40 2024-04-17T14:40:22.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.899+0000 7f689be00640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 0x7f688006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:22.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.899+0000 7f68a3400640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 0x7f688006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:22.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.899+0000 7f68a3400640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 0x7f688006a8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6894003b90 tx=0x7f68940098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:22.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:22.899+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f689c0f1c20 con 0x7f68a415be40 2024-04-17T14:40:23.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.155+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f689c018830 con 0x7f68a415be40 2024-04-17T14:40:23.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.355+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68a41555e0 con 0x7f68a415be40 2024-04-17T14:40:23.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.367+0000 7f689be00640 1 -- 172.21.15.16:0/3299890352 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7f689c0f3b80 con 0x7f68a415be40 2024-04-17T14:40:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:23.368 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T14:40:23.369 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T14:40:23.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 msgr2=0x7f688006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 0x7f688006a8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6894003b90 tx=0x7f68940098d0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 msgr2=0x7f68a41f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f689c01c900 tx=0x7f689c01ba70 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 shutdown_connections 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6880068400 0x7f688006a8c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a415be40 0x7f68a41f4df0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68a4151db0 0x7f68a414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 --2- 172.21.15.16:0/3299890352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68a40c5a20 0x7f68a4156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 >> 172.21.15.16:0/3299890352 conn(0x7f68a406ba30 msgr2=0x7f68a40c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 shutdown_connections 2024-04-17T14:40:23.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.371+0000 7f68aa600640 1 -- 172.21.15.16:0/3299890352 wait complete. 2024-04-17T14:40:23.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T14:40:23.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 Processor -- start 2024-04-17T14:40:23.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 -- start start 2024-04-17T14:40:23.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f228415be40 0x7f22840c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f22840c5a20 0x7f22840c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2284158610 con 0x7f2284151db0 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f22840c8be0 con 0x7f228415be40 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.535+0000 7f2289e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2284071b30 con 0x7f22840c5a20 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f228415be40 0x7f22840c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f228415be40 0x7f22840c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33260/0 (socket says 172.21.15.16:33260) 2024-04-17T14:40:23.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 -- 172.21.15.16:0/3037598885 learned_addr learned my addr 172.21.15.16:0/3037598885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:23.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f2283400640 1 --2- 172.21.15.16:0/3037598885 >> v2:172.21.15.67:3300/0 conn(0x7f22840c5a20 0x7f22840c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 -- 172.21.15.16:0/3037598885 >> v2:172.21.15.67:3300/0 conn(0x7f22840c5a20 msgr2=0x7f22840c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:23.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 --2- 172.21.15.16:0/3037598885 >> v2:172.21.15.67:3300/0 conn(0x7f22840c5a20 0x7f22840c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 -- 172.21.15.16:0/3037598885 >> v1:172.21.15.16:6789/0 conn(0x7f2284151db0 legacy=0x7f2284157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.539+0000 7f227a000640 1 -- 172.21.15.16:0/3037598885 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22841588f0 con 0x7f228415be40 2024-04-17T14:40:23.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.547+0000 7f227a000640 1 --2- 172.21.15.16:0/3037598885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228415be40 0x7f22840c86a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22840c5940 tx=0x7f226c0213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae4c146950c4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:23.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2282000640 1 -- 172.21.15.16:0/3037598885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b6070 con 0x7f228415be40 2024-04-17T14:40:23.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2282000640 1 -- 172.21.15.16:0/3037598885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0b1600 con 0x7f228415be40 2024-04-17T14:40:23.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2282000640 1 -- 172.21.15.16:0/3037598885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b19d0 con 0x7f228415be40 2024-04-17T14:40:23.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 -- 172.21.15.16:0/3037598885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228415be40 msgr2=0x7f22840c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 --2- 172.21.15.16:0/3037598885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228415be40 0x7f22840c86a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22840c5940 tx=0x7f226c0213e0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 -- 172.21.15.16:0/3037598885 shutdown_connections 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 --2- 172.21.15.16:0/3037598885 >> v2:172.21.15.67:3300/0 conn(0x7f22840c5a20 0x7f22840c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 --2- 172.21.15.16:0/3037598885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228415be40 0x7f22840c86a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 -- 172.21.15.16:0/3037598885 >> 172.21.15.16:0/3037598885 conn(0x7f228406ba30 msgr2=0x7f228406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 -- 172.21.15.16:0/3037598885 shutdown_connections 2024-04-17T14:40:23.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.555+0000 7f2289e00640 1 -- 172.21.15.16:0/3037598885 wait complete. 2024-04-17T14:40:23.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 Processor -- start 2024-04-17T14:40:23.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 -- start start 2024-04-17T14:40:23.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22840c5a20 0x7f22841f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415be40 0x7f22841f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f228415b920 con 0x7f2284151db0 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f228415b640 con 0x7f228415be40 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f2289e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f22841582e0 con 0x7f22840c5a20 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f227a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f227a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33264/0 (socket says 172.21.15.16:33264) 2024-04-17T14:40:23.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.559+0000 7f227a000640 1 -- 172.21.15.16:0/2480034613 learned_addr learned my addr 172.21.15.16:0/2480034613 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:23.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f2283400640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415be40 0x7f22841f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f2282a00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22840c5a20 0x7f22841f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f227a000640 1 -- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22840c5a20 msgr2=0x7f22841f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f227a000640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22840c5a20 0x7f22841f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f227a000640 1 -- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415be40 msgr2=0x7f22841f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f227a000640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415be40 0x7f22841f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:23.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.563+0000 7f227a000640 1 -- 172.21.15.16:0/2480034613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22841f4940 con 0x7f2284151db0 2024-04-17T14:40:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.567+0000 7f227a000640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f226c01dff0 tx=0x7f226c01e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:23.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.571+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0c0070 con 0x7f2284151db0 2024-04-17T14:40:23.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.571+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0ba420 con 0x7f2284151db0 2024-04-17T14:40:23.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.571+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22841f4c20 con 0x7f2284151db0 2024-04-17T14:40:23.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.571+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b6040 con 0x7f2284151db0 2024-04-17T14:40:23.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.571+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22841f51e0 con 0x7f2284151db0 2024-04-17T14:40:23.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.575+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2284076280 con 0x7f2284151db0 2024-04-17T14:40:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.899+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f226c0c3020 con 0x7f2284151db0 2024-04-17T14:40:23.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.899+0000 7f227be00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 0x7f226006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:23.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.899+0000 7f2282a00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 0x7f226006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.899+0000 7f2282a00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 0x7f226006a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2274001cc0 tx=0x7f2274009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:23.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.911+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f226c0f1d40 con 0x7f2284151db0 2024-04-17T14:40:23.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:23.911+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f226c01af40 con 0x7f2284151db0 2024-04-17T14:40:24.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.083+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22840c4400 con 0x7f2284151db0 2024-04-17T14:40:24.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f227be00640 1 -- 172.21.15.16:0/2480034613 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7f226c0f43a0 con 0x7f2284151db0 2024-04-17T14:40:24.125 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:24.126 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 msgr2=0x7f226006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 0x7f226006a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2274001cc0 tx=0x7f2274009040 comp rx=0 tx=0).stop 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 msgr2=0x7f22840c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f226c01dff0 tx=0x7f226c01e180 comp rx=0 tx=0).stop 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 shutdown_connections 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f22600683d0 0x7f226006a890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f228415be40 0x7f22841f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2284151db0 0x7f22840c6dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 --2- 172.21.15.16:0/2480034613 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22840c5a20 0x7f22841f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 >> 172.21.15.16:0/2480034613 conn(0x7f228406ba30 msgr2=0x7f2284157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 shutdown_connections 2024-04-17T14:40:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.127+0000 7f2289e00640 1 -- 172.21.15.16:0/2480034613 wait complete. 2024-04-17T14:40:24.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T14:40:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 Processor -- start 2024-04-17T14:40:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 -- start start 2024-04-17T14:40:24.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ed415f070 0x7f7ed40c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed40cb100 con 0x7f7ed415ec50 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed40c8d40 con 0x7f7ed415f070 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed9c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed415b400 con 0x7f7ed4155080 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.291+0000 7f7ed3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ed415f070 0x7f7ed40c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ecbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7ed415ec50 0x7f7ed40ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37840/0 (socket says 172.21.15.16:37840) 2024-04-17T14:40:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ecbe00640 1 -- 172.21.15.16:0/518365646 learned_addr learned my addr 172.21.15.16:0/518365646 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T14:40:24.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ed2a00640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ed3400640 1 -- 172.21.15.16:0/518365646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 msgr2=0x7f7ed415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:24.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ed3400640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ed3400640 1 -- 172.21.15.16:0/518365646 >> v1:172.21.15.16:6789/0 conn(0x7f7ed415ec50 legacy=0x7f7ed40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.295+0000 7f7ed3400640 1 -- 172.21.15.16:0/518365646 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed415b6e0 con 0x7f7ed415f070 2024-04-17T14:40:24.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.303+0000 7f7ed3400640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415f070 0x7f7ed40c94f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009d90 tx=0x7f7ecc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814a9f480f1632fa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed2000640 1 -- 172.21.15.16:0/518365646 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0b4070 con 0x7f7ed415f070 2024-04-17T14:40:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed2000640 1 -- 172.21.15.16:0/518365646 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0af600 con 0x7f7ed415f070 2024-04-17T14:40:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed2000640 1 -- 172.21.15.16:0/518365646 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0af9d0 con 0x7f7ed415f070 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- 172.21.15.16:0/518365646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415f070 msgr2=0x7f7ed40c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415f070 0x7f7ed40c94f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009d90 tx=0x7f7ecc01f150 comp rx=0 tx=0).stop 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- 172.21.15.16:0/518365646 shutdown_connections 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415f070 0x7f7ed40c94f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/518365646 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- 172.21.15.16:0/518365646 >> 172.21.15.16:0/518365646 conn(0x7f7ed406fd20 msgr2=0x7f7ed4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- 172.21.15.16:0/518365646 shutdown_connections 2024-04-17T14:40:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- 172.21.15.16:0/518365646 wait complete. 2024-04-17T14:40:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 Processor -- start 2024-04-17T14:40:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.307+0000 7f7ed9c00640 1 -- start start 2024-04-17T14:40:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed4155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ed415f070 0x7f7ed415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed415e730 con 0x7f7ed415ec50 2024-04-17T14:40:24.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed415e450 con 0x7f7ed415f070 2024-04-17T14:40:24.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed9c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed4155460 con 0x7f7ed4155080 2024-04-17T14:40:24.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ecbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ecbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33282/0 (socket says 172.21.15.16:33282) 2024-04-17T14:40:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ecbe00640 1 -- 172.21.15.16:0/3637516403 learned_addr learned my addr 172.21.15.16:0/3637516403 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed3400640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ed415f070 0x7f7ed415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.311+0000 7f7ed2a00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed4155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 -- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 msgr2=0x7f7ed4155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed4155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 -- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ed415f070 msgr2=0x7f7ed415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ed415f070 0x7f7ed415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 -- 172.21.15.16:0/3637516403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed40c7190 con 0x7f7ed415ec50 2024-04-17T14:40:24.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.315+0000 7f7ecbe00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c450 tx=0x7f7ebc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.319+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc017070 con 0x7f7ed415ec50 2024-04-17T14:40:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.319+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc005cf0 con 0x7f7ed415ec50 2024-04-17T14:40:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.319+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc007290 con 0x7f7ed415ec50 2024-04-17T14:40:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.319+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed40c7470 con 0x7f7ed415ec50 2024-04-17T14:40:24.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.319+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed40c6100 con 0x7f7ed415ec50 2024-04-17T14:40:24.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.323+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed4076280 con 0x7f7ed415ec50 2024-04-17T14:40:24.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.339+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ebc01a070 con 0x7f7ed415ec50 2024-04-17T14:40:24.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.343+0000 7f7ecaa00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 0x7f7eb006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:24.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.343+0000 7f7ed2a00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 0x7f7eb006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:24.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.343+0000 7f7ed2a00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 0x7f7eb006a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009ac0 tx=0x7f7ec4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:24.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.343+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7ebc0540c0 con 0x7f7ed415ec50 2024-04-17T14:40:24.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.603+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7ebc021020 con 0x7f7ed415ec50 2024-04-17T14:40:24.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.819+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ed406f5a0 con 0x7f7ed415ec50 2024-04-17T14:40:24.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ecaa00640 1 -- 172.21.15.16:0/3637516403 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7f7ebc056020 con 0x7f7ed415ec50 2024-04-17T14:40:24.833 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T14:40:24.833 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T14:40:24.833 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T14:40:24.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 msgr2=0x7f7eb006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 0x7f7eb006a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009ac0 tx=0x7f7ec4009190 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 msgr2=0x7f7ed41f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c450 tx=0x7f7ebc00c910 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 shutdown_connections 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f7eb00683d0 0x7f7eb006a890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ed415f070 0x7f7ed415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed415ec50 0x7f7ed41f4960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 --2- 172.21.15.16:0/3637516403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7ed4155080 0x7f7ed4155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 >> 172.21.15.16:0/3637516403 conn(0x7f7ed406fd20 msgr2=0x7f7ed415cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 shutdown_connections 2024-04-17T14:40:24.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:24.835+0000 7f7ed9c00640 1 -- 172.21.15.16:0/3637516403 wait complete. 2024-04-17T14:40:25.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T14:39:58.980805+0000', 'modified': '2024-04-17T14:40:04.134775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14216}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14216': {'gid': 14216, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.67:6835/4079650926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 4079650926}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 4079650926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 14216, 'qdb_cluster': [14216]} 2024-04-17T14:40:25.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T14:40:25.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-17T14:40:25.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 Processor -- start 2024-04-17T14:40:25.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 -- start start 2024-04-17T14:40:25.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2f04151db0 0x7f2f040c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f0415be40 0x7f2f04157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f04158610 con 0x7f2f04158110 2024-04-17T14:40:25.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2f040c8be0 con 0x7f2f04151db0 2024-04-17T14:40:25.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.607+0000 7f2f0bc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2f04071b30 con 0x7f2f0415be40 2024-04-17T14:40:25.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2f04151db0 0x7f2f040c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2f04151db0 0x7f2f040c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33294/0 (socket says 172.21.15.16:33294) 2024-04-17T14:40:25.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 -- 172.21.15.16:0/3334324668 learned_addr learned my addr 172.21.15.16:0/3334324668 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:25.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 -- 172.21.15.16:0/3334324668 >> v2:172.21.15.67:3300/0 conn(0x7f2f0415be40 msgr2=0x7f2f04157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 --2- 172.21.15.16:0/3334324668 >> v2:172.21.15.67:3300/0 conn(0x7f2f0415be40 0x7f2f04157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 -- 172.21.15.16:0/3334324668 >> v1:172.21.15.16:6789/0 conn(0x7f2f04158110 legacy=0x7f2f040c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.611+0000 7f2f09200640 1 -- 172.21.15.16:0/3334324668 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f041588f0 con 0x7f2f04151db0 2024-04-17T14:40:25.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.619+0000 7f2f09200640 1 --2- 172.21.15.16:0/3334324668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04151db0 0x7f2f040c86a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f040716d0 tx=0x7f2ef801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da588038674e4a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:25.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.623+0000 7f2f03400640 1 -- 172.21.15.16:0/3334324668 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80b5070 con 0x7f2f04151db0 2024-04-17T14:40:25.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.623+0000 7f2f03400640 1 -- 172.21.15.16:0/3334324668 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80a89d0 con 0x7f2f04151db0 2024-04-17T14:40:25.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.623+0000 7f2f03400640 1 -- 172.21.15.16:0/3334324668 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80a8da0 con 0x7f2f04151db0 2024-04-17T14:40:25.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- 172.21.15.16:0/3334324668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04151db0 msgr2=0x7f2f040c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:25.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/3334324668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04151db0 0x7f2f040c86a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f040716d0 tx=0x7f2ef801ecd0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- 172.21.15.16:0/3334324668 shutdown_connections 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/3334324668 >> v2:172.21.15.67:3300/0 conn(0x7f2f0415be40 0x7f2f04157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/3334324668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04151db0 0x7f2f040c86a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- 172.21.15.16:0/3334324668 >> 172.21.15.16:0/3334324668 conn(0x7f2f0406ba30 msgr2=0x7f2f0406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- 172.21.15.16:0/3334324668 shutdown_connections 2024-04-17T14:40:25.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- 172.21.15.16:0/3334324668 wait complete. 2024-04-17T14:40:25.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 Processor -- start 2024-04-17T14:40:25.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- start start 2024-04-17T14:40:25.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f04151db0 0x7f2f04145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415be40 0x7f2f041e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0415b920 con 0x7f2f04158110 2024-04-17T14:40:25.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0415b640 con 0x7f2f04151db0 2024-04-17T14:40:25.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f0bc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f2f040c4080 con 0x7f2f0415be40 2024-04-17T14:40:25.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.627+0000 7f2f03e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33308/0 (socket says 172.21.15.16:33308) 2024-04-17T14:40:25.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 -- 172.21.15.16:0/2243188208 learned_addr learned my addr 172.21.15.16:0/2243188208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:25.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f09200640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f04151db0 0x7f2f04145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f09c00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415be40 0x7f2f041e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 -- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415be40 msgr2=0x7f2f041e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:25.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415be40 0x7f2f041e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 -- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f04151db0 msgr2=0x7f2f04145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:25.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f04151db0 0x7f2f04145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.631+0000 7f2f03e00640 1 -- 172.21.15.16:0/2243188208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f041e2dc0 con 0x7f2f04158110 2024-04-17T14:40:25.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.635+0000 7f2f03e00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b580 tx=0x7f2ef000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:25.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.639+0000 7f2f00c00640 1 -- 172.21.15.16:0/2243188208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0014070 con 0x7f2f04158110 2024-04-17T14:40:25.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.639+0000 7f2f00c00640 1 -- 172.21.15.16:0/2243188208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef0010890 con 0x7f2f04158110 2024-04-17T14:40:25.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.639+0000 7f2f00c00640 1 -- 172.21.15.16:0/2243188208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0010c80 con 0x7f2f04158110 2024-04-17T14:40:25.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.639+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f041478a0 con 0x7f2f04158110 2024-04-17T14:40:25.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.639+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f041ee9e0 con 0x7f2f04158110 2024-04-17T14:40:25.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 Processor -- start 2024-04-17T14:40:25.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 -- start start 2024-04-17T14:40:25.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 0x5621b3a06a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a0a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a0b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b38184d0 con 0x5621b3a0ae50 2024-04-17T14:40:25.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5621b37b2bf0 con 0x5621b3a06650 2024-04-17T14:40:25.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.643+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x5621b3814490 con 0x5621b3a06f70 2024-04-17T14:40:25.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.651+0000 7f2f09200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a0a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.651+0000 7f2f09c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 0x5621b3a06a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.651+0000 7f2f09200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a0a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:56508/0 (socket says 172.21.15.16:56508) 2024-04-17T14:40:25.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.651+0000 7f2f09200640 1 -- 172.21.15.16:0/4280586084 learned_addr learned my addr 172.21.15.16:0/4280586084 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:25.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.659+0000 7f2f09c00640 1 -- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 msgr2=0x5621b3a0a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.659+0000 7f2f09c00640 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a0a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.659+0000 7f2f09c00640 1 -- 172.21.15.16:0/4280586084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 msgr2=0x5621b3a0b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.659+0000 7f2f09c00640 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a0b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.659+0000 7f2f09c00640 1 -- 172.21.15.16:0/4280586084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b379ee80 con 0x5621b3a06650 2024-04-17T14:40:25.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.663+0000 7f2f00c00640 1 -- 172.21.15.16:0/2243188208 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ef0017070 con 0x7f2f04158110 2024-04-17T14:40:25.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.663+0000 7f2f00c00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 0x7f2ee406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.663+0000 7f2f09200640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 0x7f2ee406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.663+0000 7f2f00c00640 1 -- 172.21.15.16:0/2243188208 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2ef0056840 con 0x7f2f04158110 2024-04-17T14:40:25.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.663+0000 7f2f09200640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 0x7f2ee406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801c900 tx=0x7f2ef80aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:25.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.667+0000 7f2f09c00640 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 0x5621b3a06a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005610 tx=0x7f2efc00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8708dbdf11150184 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:25.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2ef5600640 1 -- 172.21.15.16:0/4280586084 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc018030 con 0x5621b3a06650 2024-04-17T14:40:25.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2ef5600640 1 -- 172.21.15.16:0/4280586084 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2efc005820 con 0x5621b3a06650 2024-04-17T14:40:25.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2ef5600640 1 -- 172.21.15.16:0/4280586084 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc006b60 con 0x5621b3a06650 2024-04-17T14:40:25.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 msgr2=0x5621b3a06a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:25.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 0x5621b3a06a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005610 tx=0x7f2efc00f5a0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- 172.21.15.16:0/4280586084 shutdown_connections 2024-04-17T14:40:25.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a0b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a0a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/4280586084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06650 0x5621b3a06a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- 172.21.15.16:0/4280586084 >> 172.21.15.16:0/4280586084 conn(0x5621b3a076d0 msgr2=0x5621b3a09ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- 172.21.15.16:0/4280586084 shutdown_connections 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- 172.21.15.16:0/4280586084 wait complete. 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- start start 2024-04-17T14:40:25.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 Processor -- start 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a05820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 0x5621b3a05d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b37d5a60 con 0x5621b3a0ae50 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5621b37bce80 con 0x5621b3a06f70 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x5621b37d3cf0 con 0x5621b3a06650 2024-04-17T14:40:25.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.679+0000 7f2f0efc4000 10 client.0 _ll_register_callbacks cb 0x5621b39b5a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T14:40:25.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33328/0 (socket says 172.21.15.16:33328) 2024-04-17T14:40:25.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 -- 172.21.15.16:0/1922337844 learned_addr learned my addr 172.21.15.16:0/1922337844 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:25.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09200640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a05820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f03e00640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 0x5621b3a05d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 -- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 msgr2=0x5621b3a05820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a05820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 -- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 msgr2=0x5621b3a05d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 0x5621b3a05d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f09c00640 1 -- 172.21.15.16:0/1922337844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b37b2e40 con 0x5621b3a0ae50 2024-04-17T14:40:25.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.683+0000 7f2f03e00640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 0x5621b3a05d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T14:40:25.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.687+0000 7f2f09c00640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0146a0 tx=0x7f2efc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50ad53fa0448ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:25.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.687+0000 7f2eea000640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-17T14:40:25.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc014d50 con 0x5621b3a0ae50 2024-04-17T14:40:25.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2efc024450 con 0x5621b3a0ae50 2024-04-17T14:40:25.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621b37b1bc0 con 0x5621b3a0ae50 2024-04-17T14:40:25.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2efc02c050 con 0x5621b3a0ae50 2024-04-17T14:40:25.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2f0efc4000 10 client.4569 fetch_fsmap learned FSMap version 7 2024-04-17T14:40:25.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.691+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5621b37e3e00 con 0x5621b3a0ae50 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5621b37b1bc0 con 0x5621b3a0ae50 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 4705+0+0 (secure 0 0 0) 0x7f2efc02f020 con 0x5621b3a0ae50 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 10 client.4569 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 10 client.4569 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 20 client.4569 populate_metadata read hostname 'smithi016' 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a192b0 0x5621b3a19690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 4 client.4569 mds_command: new command op to 14216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T14:40:25.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.699+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 --> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621b3825ef0 con 0x5621b3a192b0 2024-04-17T14:40:25.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.723+0000 7f2f09200640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a192b0 0x5621b3a19690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:25.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.855+0000 7f2f09200640 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a192b0 0x5621b3a19690 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d57a199930746bd server_cookie=89e672fac975c4e7 in_seq=0 out_seq=0 2024-04-17T14:40:25.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:25.855+0000 7f2eea000640 10 client.4569 ms_handle_connect on v2:172.21.15.67:6834/4079650926 2024-04-17T14:40:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2eea000640 1 -- 172.21.15.16:0/1922337844 <== mds.0 v2:172.21.15.67:6834/4079650926 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621b3825ef0 con 0x5621b3a192b0 2024-04-17T14:40:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2eea000640 10 client.4569 handle_command_reply: tid=0 2024-04-17T14:40:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 client.4569 shutdown 2024-04-17T14:40:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 msgr2=0x5621b3a18510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0146a0 tx=0x7f2efc003a80 comp rx=0 tx=0).stop 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 shutdown_connections 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a192b0 0x5621b3a19690 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a0ae50 0x5621b3a18510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a06f70 0x5621b3a05d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/1922337844 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a05820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2eea000640 0 client.4569 ms_handle_reset on v2:172.21.15.67:6834/4079650926 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 >> 172.21.15.16:0/1922337844 conn(0x5621b3a076d0 msgr2=0x5621b39c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 shutdown_connections 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 1 -- 172.21.15.16:0/1922337844 wait complete. 2024-04-17T14:40:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.111+0000 7f2f0efc4000 20 client.4569 trim_cache size 0 max 16384 2024-04-17T14:40:26.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.127+0000 7f2f0efc4000 1 Processor -- start 2024-04-17T14:40:26.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.127+0000 7f2f0efc4000 1 -- start start 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a7c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 0x5621b3a7c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a7cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b38177e0 con 0x5621b3a06f70 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5621b381cb00 con 0x5621b3a0ae50 2024-04-17T14:40:26.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x5621b38256e0 con 0x5621b3a06650 2024-04-17T14:40:26.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.131+0000 7f2f09200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a7c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.139+0000 7f2f09c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a7cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.139+0000 7f2f09c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a7cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:42660/0 (socket says 172.21.15.16:42660) 2024-04-17T14:40:26.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.139+0000 7f2f09c00640 1 -- 172.21.15.16:0/3065043934 learned_addr learned my addr 172.21.15.16:0/3065043934 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:26.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.171+0000 7f2f03e00640 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 0x5621b3a7c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.175+0000 7f2f03e00640 1 -- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 msgr2=0x5621b3a7c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.175+0000 7f2f03e00640 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a7c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.175+0000 7f2f03e00640 1 -- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 msgr2=0x5621b3a7cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.175+0000 7f2f03e00640 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a7cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.175+0000 7f2f03e00640 1 -- 172.21.15.16:0/3065043934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b3899d30 con 0x5621b3a06f70 2024-04-17T14:40:26.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.179+0000 7f2f03e00640 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 0x5621b3a7c9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b550 tx=0x7f2ef0058410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c58e6f8cfe5e65c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:26.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.179+0000 7f2ef4c00640 1 -- 172.21.15.16:0/3065043934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0085070 con 0x5621b3a06f70 2024-04-17T14:40:26.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2ef4c00640 1 -- 172.21.15.16:0/3065043934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef006f070 con 0x5621b3a06f70 2024-04-17T14:40:26.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2ef4c00640 1 -- 172.21.15.16:0/3065043934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef001e040 con 0x5621b3a06f70 2024-04-17T14:40:26.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- 172.21.15.16:0/3065043934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 msgr2=0x5621b3a7c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 0x5621b3a7c9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b550 tx=0x7f2ef0058410 comp rx=0 tx=0).stop 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- 172.21.15.16:0/3065043934 shutdown_connections 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a7cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06f70 0x5621b3a7c9c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/3065043934 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06650 0x5621b3a7c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- 172.21.15.16:0/3065043934 >> 172.21.15.16:0/3065043934 conn(0x5621b3a076d0 msgr2=0x5621b3a1acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- 172.21.15.16:0/3065043934 shutdown_connections 2024-04-17T14:40:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- 172.21.15.16:0/3065043934 wait complete. 2024-04-17T14:40:26.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- start start 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 Processor -- start 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 0x5621b3a808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a80df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a1f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b38d9a80 con 0x5621b3a06650 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5621b37ae7b0 con 0x5621b3a0ae50 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x5621b37deaf0 con 0x5621b3a06f70 2024-04-17T14:40:26.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.183+0000 7f2f0efc4000 10 client.0 _ll_register_callbacks cb 0x7f2ef80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T14:40:26.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.187+0000 7f2f03e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a80df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.191+0000 7f2f03e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a80df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:56542/0 (socket says 172.21.15.16:56542) 2024-04-17T14:40:26.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.191+0000 7f2f03e00640 1 -- 172.21.15.16:0/2105271886 learned_addr learned my addr 172.21.15.16:0/2105271886 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:26.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.191+0000 7f2f09200640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 0x5621b3a808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 -- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 msgr2=0x5621b3a80df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a80df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 -- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 msgr2=0x5621b3a1f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a1f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 -- 172.21.15.16:0/2105271886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b37aa7c0 con 0x5621b3a06650 2024-04-17T14:40:26.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2f09200640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 0x5621b3a808b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801b8e0 tx=0x7f2ef80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1724b365f86966e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:26.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.195+0000 7f2eea000640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-17T14:40:26.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.199+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80c0040 con 0x5621b3a06650 2024-04-17T14:40:26.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.199+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2ef80bcb30 con 0x5621b3a06650 2024-04-17T14:40:26.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.199+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ef006f070 con 0x5621b3a06650 2024-04-17T14:40:26.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.203+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2ef80b5040 con 0x5621b3a06650 2024-04-17T14:40:26.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.203+0000 7f2f0efc4000 10 client.4575 fetch_fsmap learned FSMap version 7 2024-04-17T14:40:26.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.203+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5621b37bd650 con 0x5621b3a06650 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef006f070 con 0x5621b3a06650 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 4705+0+0 (secure 0 0 0) 0x7f2ef80df020 con 0x5621b3a06650 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 10 client.4575 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 10 client.4575 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 20 client.4575 populate_metadata read hostname 'smithi016' 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a8a950 0x5621b3a204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 4 client.4575 mds_command: new command op to 14216 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T14:40:26.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 --> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] -- command(tid 0: {"prefix": "status"}) -- 0x5621b381fd60 con 0x5621b3a8a950 2024-04-17T14:40:26.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.207+0000 7f2f03e00640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a8a950 0x5621b3a204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.215+0000 7f2f03e00640 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a8a950 0x5621b3a204f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc4df5bd9360b60 server_cookie=955ed93836951898 in_seq=0 out_seq=0 2024-04-17T14:40:26.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.215+0000 7f2eea000640 10 client.4575 ms_handle_connect on v2:172.21.15.67:6834/4079650926 2024-04-17T14:40:26.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2eea000640 1 -- 172.21.15.16:0/2105271886 <== mds.0 v2:172.21.15.67:6834/4079650926 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5621b381fd60 con 0x5621b3a8a950 2024-04-17T14:40:26.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2eea000640 10 client.4575 handle_command_reply: tid=0 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 client.4575 shutdown 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 msgr2=0x5621b3a808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 0x5621b3a808b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801b8e0 tx=0x7f2ef80046d0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 shutdown_connections 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:6834/4079650926,v1:172.21.15.67:6835/4079650926] conn(0x5621b3a8a950 0x5621b3a204f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5621b3a0ae50 0x5621b3a1f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5621b3a06f70 0x5621b3a80df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 --2- 172.21.15.16:0/2105271886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b3a06650 0x5621b3a808b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2eea000640 0 client.4575 ms_handle_reset on v2:172.21.15.67:6834/4079650926 2024-04-17T14:40:26.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 >> 172.21.15.16:0/2105271886 conn(0x5621b3a076d0 msgr2=0x5621b3a17b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:26.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 shutdown_connections 2024-04-17T14:40:26.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 1 -- 172.21.15.16:0/2105271886 wait complete. 2024-04-17T14:40:26.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.239+0000 7f2f0efc4000 20 client.4575 trim_cache size 0 max 16384 2024-04-17T14:40:26.242 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T14:40:26.242 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "a4da2728-df57-41cc-8313-34e85a419083", 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 14216, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 26.518329531999999, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 7, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 25, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 23, 2024-04-17T14:40:26.243 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 42.360095665999999 2024-04-17T14:40:26.244 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T14:40:26.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 msgr2=0x7f2ee406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 0x7f2ee406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801c900 tx=0x7f2ef80aa070 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 msgr2=0x7f2f041ef1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b580 tx=0x7f2ef000ba40 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 shutdown_connections 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2ee40683d0 0x7f2ee406a890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f0415be40 0x7f2f041e22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f04158110 0x7f2f041ef1e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 --2- 172.21.15.16:0/2243188208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f04151db0 0x7f2f04145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 >> 172.21.15.16:0/2243188208 conn(0x7f2f0406ba30 msgr2=0x7f2f040c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:26.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 shutdown_connections 2024-04-17T14:40:26.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.243+0000 7f2f0bc00640 1 -- 172.21.15.16:0/2243188208 wait complete. 2024-04-17T14:40:26.260 INFO:teuthology.run_tasks:Running task sequential... 2024-04-17T14:40:26.273 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-17T14:40:26.273 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-17T14:40:26.274 INFO:teuthology.task.print:Enabling mgr modules 2024-04-17T14:40:26.274 INFO:teuthology.run_tasks:Running task kclient... 2024-04-17T14:40:26.303 INFO:tasks.kclient:Mounting kernel clients... 2024-04-17T14:40:26.303 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-17T14:40:26.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:26.303 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-17T14:40:26.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:26.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-17T14:40:26.382 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-04-17T14:40:26.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T14:40:26.385 INFO:tasks.kclient:client.0 config is {} 2024-04-17T14:40:26.385 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T14:40:26.385 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:26.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T14:40:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.567+0000 7f45c8a00640 1 Processor -- start 2024-04-17T14:40:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.567+0000 7f45c8a00640 1 -- start start 2024-04-17T14:40:26.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45c40c6490 0x7f45c40c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45c4157fa0 0x7f45c406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f45c40c50f0 con 0x7f45c4157fa0 2024-04-17T14:40:26.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f45c4071b60 con 0x7f45c40c6490 2024-04-17T14:40:26.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f45c4071e40 con 0x7f45c4151740 2024-04-17T14:40:26.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45c4157fa0 0x7f45c406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45c4157fa0 0x7f45c406ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33372/0 (socket says 172.21.15.16:33372) 2024-04-17T14:40:26.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c2800640 1 -- 172.21.15.16:0/359186401 learned_addr learned my addr 172.21.15.16:0/359186401 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:26.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45c1e00640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.571+0000 7f45bbe00640 1 --2- 172.21.15.16:0/359186401 >> v2:172.21.15.67:3300/0 conn(0x7f45c40c6490 0x7f45c40c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.575+0000 7f45c2800640 1 -- 172.21.15.16:0/359186401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 msgr2=0x7f45c40c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.575+0000 7f45c2800640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.575+0000 7f45c2800640 1 -- 172.21.15.16:0/359186401 >> v2:172.21.15.67:3300/0 conn(0x7f45c40c6490 msgr2=0x7f45c40c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T14:40:26.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.575+0000 7f45c2800640 1 --2- 172.21.15.16:0/359186401 >> v2:172.21.15.67:3300/0 conn(0x7f45c40c6490 0x7f45c40c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.575+0000 7f45c2800640 1 -- 172.21.15.16:0/359186401 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c40c5360 con 0x7f45c4157fa0 2024-04-17T14:40:26.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.579+0000 7f45c2800640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c406ef10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45c40c9880 tx=0x7f45bc01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ee3f46a342229b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:26.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c1400640 1 -- 172.21.15.16:0/359186401 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0a7a00 con 0x7f45c4157fa0 2024-04-17T14:40:26.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c1400640 1 -- 172.21.15.16:0/359186401 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc0a7ba0 con 0x7f45c4157fa0 2024-04-17T14:40:26.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c1400640 1 -- 172.21.15.16:0/359186401 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0af3f0 con 0x7f45c4157fa0 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- 172.21.15.16:0/359186401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 msgr2=0x7f45c406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c406ef10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45c40c9880 tx=0x7f45bc01ebd0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- 172.21.15.16:0/359186401 shutdown_connections 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c406ef10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- 172.21.15.16:0/359186401 >> v2:172.21.15.67:3300/0 conn(0x7f45c40c6490 0x7f45c40c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- 172.21.15.16:0/359186401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- 172.21.15.16:0/359186401 >> 172.21.15.16:0/359186401 conn(0x7f45c406ba30 msgr2=0x7f45c406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:26.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- 172.21.15.16:0/359186401 shutdown_connections 2024-04-17T14:40:26.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- 172.21.15.16:0/359186401 wait complete. 2024-04-17T14:40:26.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 Processor -- start 2024-04-17T14:40:26.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- start start 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45c40c6490 0x7f45c4148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40c8d20 con 0x7f45c4157fa0 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40c8ba0 con 0x7f45c40c6490 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.583+0000 7f45c8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f45c4151b20 con 0x7f45c4151740 2024-04-17T14:40:26.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.587+0000 7f45c2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.587+0000 7f45c2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33380/0 (socket says 172.21.15.16:33380) 2024-04-17T14:40:26.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.587+0000 7f45c2800640 1 -- 172.21.15.16:0/3221384573 learned_addr learned my addr 172.21.15.16:0/3221384573 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T14:40:26.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.587+0000 7f45bbe00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.587+0000 7f45c1e00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45c40c6490 0x7f45c4148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 -- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 msgr2=0x7f45c40cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 -- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45c40c6490 msgr2=0x7f45c4148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45c40c6490 0x7f45c4148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 -- 172.21.15.16:0/3221384573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c4153a90 con 0x7f45c4157fa0 2024-04-17T14:40:26.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.591+0000 7f45c2800640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01f470 tx=0x7f45bc01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:26.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0be020 con 0x7f45c4157fa0 2024-04-17T14:40:26.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc0ba470 con 0x7f45c4157fa0 2024-04-17T14:40:26.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c4153d70 con 0x7f45c4157fa0 2024-04-17T14:40:26.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0a7a00 con 0x7f45c4157fa0 2024-04-17T14:40:26.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c4154330 con 0x7f45c4157fa0 2024-04-17T14:40:26.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.595+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c4076280 con 0x7f45c4157fa0 2024-04-17T14:40:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.863+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45bc0c1020 con 0x7f45c4157fa0 2024-04-17T14:40:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.863+0000 7f45ba000640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 0x7f45a006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T14:40:26.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.863+0000 7f45c1e00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 0x7f45a006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T14:40:26.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.867+0000 7f45c1e00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 0x7f45a006a890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45c41450c0 tx=0x7f45b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T14:40:26.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.891+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f45bc0f2320 con 0x7f45c4157fa0 2024-04-17T14:40:26.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:26.891+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f45bc0c8030 con 0x7f45c4157fa0 2024-04-17T14:40:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.095+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f45c40c3750 con 0x7f45c4157fa0 2024-04-17T14:40:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.099+0000 7f45ba000640 1 -- 172.21.15.16:0/3221384573 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f45bc0187f0 con 0x7f45c4157fa0 2024-04-17T14:40:27.099 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-17T14:40:27.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 msgr2=0x7f45a006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:27.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 0x7f45a006a890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45c41450c0 tx=0x7f45b4008040 comp rx=0 tx=0).stop 2024-04-17T14:40:27.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 msgr2=0x7f45c41f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T14:40:27.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45bc01f470 tx=0x7f45bc01b970 comp rx=0 tx=0).stop 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 shutdown_connections 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f45a00683d0 0x7f45a006a890 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45c4157fa0 0x7f45c41f12c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45c4151740 0x7f45c40cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 --2- 172.21.15.16:0/3221384573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45c40c6490 0x7f45c4148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 >> 172.21.15.16:0/3221384573 conn(0x7f45c406ba30 msgr2=0x7f45c4072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 shutdown_connections 2024-04-17T14:40:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27.103+0000 7f45c8a00640 1 -- 172.21.15.16:0/3221384573 wait complete. 2024-04-17T14:40:27.121 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T14:40:27.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T14:40:27.122 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T14:40:27.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:27.122 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-17T14:40:27.131 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T14:40:27.131 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T14:40:27.131 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-17T14:40:27.132 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 41823sec preferred_lft 41823sec 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:4e:56:7e:a7 brd ff:ff:ff:ff:ff:ff 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T14:40:27.133 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-17T14:40:27.135 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T14:40:27.135 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-17T14:40:27.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:27.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:27.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:27.295 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T14:40:27.314 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-17T14:40:27.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:27.317 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T14:40:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T14:40:27.397 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-17T14:40:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:27.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:27.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:27.537 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-17T14:40:27.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:27.546 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-17T14:40:27.596 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T14:40:27.596 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-17T14:40:27.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T14:40:27.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-17T14:40:27.597 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-17T14:40:27.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:27.729 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-17T14:40:27.729 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-17T14:40:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:27.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:27.912 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T14:40:27.912 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-17T14:40:27.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-17T14:40:27.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T14:40:27.912 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-17T14:40:28.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:28.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:28.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T14:40:28.041 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:28.049 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T14:40:28.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T14:40:28.050 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:28.103 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-17T14:40:28.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:28.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T14:40:28.193 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T14:40:28.193 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-17T14:40:29.354 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-17T14:40:29.354 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-17T14:40:29.354 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-04-17T14:40:29.354 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 0@a4da2728-df57-41cc-8313-34e85a419083.cephfs=/ 2024-04-17T14:40:29.354 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.16:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-04-17T14:40:29.359 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-17T14:40:29.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T14:40:29.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:29.516 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T14:40:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T14:40:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:30.116 INFO:teuthology.orchestra.run.smithi016.stdout:client14429 2024-04-17T14:40:30.116 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:40:30.117 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T14:40:30.126 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T14:40:30.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T14:40:30.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:40:30.766 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:40:30.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:30.840 INFO:teuthology.orchestra.run.smithi016.stdout:client14429 2024-04-17T14:40:30.841 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-17T14:40:30.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T14:40:30.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:30.980 INFO:teuthology.orchestra.run.smithi016.stdout:client14429 2024-04-17T14:40:30.981 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a4da2728-df57-41cc-8313-34e85a419083.client14429/status') 2024-04-17T14:40:31.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T14:40:31.052 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.14429 (3)172.21.15.16:0/2350766781 2024-04-17T14:40:31.052 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-04-17T14:40:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-04-17T14:40:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-04-17T14:40:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:71 bytes copied, 6.4568e-05 s, 1.1 MB/s 2024-04-17T14:40:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T14:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T14:40:31.061 INFO:teuthology.run_tasks:Running task workunit... 2024-04-17T14:40:31.073 INFO:tasks.workunit:Pulling workunits from ref a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:40:31.073 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-17T14:40:31.073 INFO:tasks.workunit:timeout=3h 2024-04-17T14:40:31.073 INFO:tasks.workunit:cleanup=True 2024-04-17T14:40:31.074 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-17 14:40:00.075706955 +0000 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-17 14:40:29.379599021 +0000 2024-04-17T14:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-17 14:40:00.075706955 +0000 2024-04-17T14:40:31.083 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-17T14:40:31.083 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-17T14:40:31.481 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T14:40:31.492 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T14:41:00.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:41:00.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:41:30.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:41:30.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:42:00.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:42:00.922 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:42:10.035 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 63% (7833/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-17T14:42:10.557 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-04-17T14:42:10.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.559 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-04-17T14:42:10.559 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.559 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T14:42:10.559 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-17T14:42:10.559 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-17T14:42:10.570 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T14:42:10.579 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T14:42:10.582 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T14:42:10.582 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T14:42:11.314 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T14:42:11.415 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T14:42:11.472 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T14:42:11.474 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T14:42:11.474 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T14:42:11.530 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T14:42:11.536 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T14:42:11.536 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T14:42:11.588 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-17T14:42:11.589 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-17T14:42:11.589 DEBUG:teuthology.orchestra.run.smithi016:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-17T14:42:11.801 INFO:tasks.workunit.client.0.smithi016.stderr:+ dbench 1 2024-04-17T14:42:11.812 INFO:tasks.workunit.client.0.smithi016.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-17T14:42:11.812 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T14:42:11.812 INFO:tasks.workunit.client.0.smithi016.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-17T14:42:11.813 INFO:tasks.workunit.client.0.smithi016.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-17T14:42:11.914 INFO:tasks.workunit.client.0.smithi016.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-17T14:42:11.914 INFO:tasks.workunit.client.0.smithi016.stdout:releasing clients 2024-04-17T14:42:12.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 51 2.10 MB/sec warmup 1 sec latency 211.446 ms 2024-04-17T14:42:13.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 129 2.88 MB/sec warmup 2 sec latency 241.081 ms 2024-04-17T14:42:14.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 173 2.35 MB/sec warmup 3 sec latency 258.735 ms 2024-04-17T14:42:15.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 223 2.16 MB/sec warmup 4 sec latency 206.770 ms 2024-04-17T14:42:16.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 255 1.93 MB/sec warmup 5 sec latency 259.787 ms 2024-04-17T14:42:17.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 279 1.74 MB/sec warmup 6 sec latency 419.054 ms 2024-04-17T14:42:18.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 297 1.57 MB/sec warmup 7 sec latency 886.697 ms 2024-04-17T14:42:19.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 331 1.50 MB/sec warmup 8 sec latency 299.006 ms 2024-04-17T14:42:20.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 357 1.42 MB/sec warmup 9 sec latency 251.305 ms 2024-04-17T14:42:21.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 381 1.36 MB/sec warmup 10 sec latency 501.152 ms 2024-04-17T14:42:22.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 413 1.33 MB/sec warmup 11 sec latency 260.719 ms 2024-04-17T14:42:23.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 453 1.33 MB/sec warmup 12 sec latency 282.507 ms 2024-04-17T14:42:24.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 485 1.30 MB/sec warmup 13 sec latency 277.601 ms 2024-04-17T14:42:25.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 513 1.27 MB/sec warmup 14 sec latency 263.857 ms 2024-04-17T14:42:26.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 654 1.40 MB/sec warmup 15 sec latency 171.595 ms 2024-04-17T14:42:27.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 710 1.33 MB/sec warmup 16 sec latency 237.218 ms 2024-04-17T14:42:28.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 769 1.26 MB/sec warmup 17 sec latency 307.133 ms 2024-04-17T14:42:29.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 811 1.19 MB/sec warmup 18 sec latency 275.025 ms 2024-04-17T14:42:30.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 846 1.14 MB/sec warmup 19 sec latency 556.636 ms 2024-04-17T14:42:31.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:42:31.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:42:31.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 892 1.08 MB/sec warmup 20 sec latency 193.051 ms 2024-04-17T14:42:32.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 926 1.04 MB/sec warmup 21 sec latency 278.465 ms 2024-04-17T14:42:33.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 970 0.99 MB/sec warmup 22 sec latency 285.696 ms 2024-04-17T14:42:34.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 971 0.95 MB/sec warmup 23 sec latency 1170.792 ms 2024-04-17T14:42:35.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 993 0.91 MB/sec warmup 24 sec latency 641.011 ms 2024-04-17T14:42:36.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1051 0.92 MB/sec warmup 25 sec latency 203.014 ms 2024-04-17T14:42:37.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1099 0.88 MB/sec warmup 26 sec latency 201.913 ms 2024-04-17T14:42:38.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1173 0.85 MB/sec warmup 27 sec latency 208.800 ms 2024-04-17T14:42:39.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1214 0.82 MB/sec warmup 28 sec latency 217.204 ms 2024-04-17T14:42:40.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1252 0.80 MB/sec warmup 29 sec latency 315.575 ms 2024-04-17T14:42:41.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1277 0.77 MB/sec warmup 30 sec latency 263.070 ms 2024-04-17T14:42:42.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1418 0.84 MB/sec warmup 31 sec latency 439.402 ms 2024-04-17T14:42:43.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1481 0.81 MB/sec warmup 32 sec latency 221.894 ms 2024-04-17T14:42:44.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1523 0.79 MB/sec warmup 33 sec latency 193.651 ms 2024-04-17T14:42:45.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1603 0.77 MB/sec warmup 34 sec latency 416.105 ms 2024-04-17T14:42:46.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1653 0.75 MB/sec warmup 35 sec latency 407.112 ms 2024-04-17T14:42:47.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1689 0.73 MB/sec warmup 36 sec latency 358.318 ms 2024-04-17T14:42:48.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1820 0.71 MB/sec warmup 37 sec latency 317.035 ms 2024-04-17T14:42:49.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1961 0.70 MB/sec warmup 38 sec latency 268.862 ms 2024-04-17T14:42:50.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2088 0.68 MB/sec warmup 39 sec latency 281.448 ms 2024-04-17T14:42:51.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2198 0.67 MB/sec warmup 40 sec latency 318.383 ms 2024-04-17T14:42:52.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2337 0.68 MB/sec warmup 41 sec latency 364.981 ms 2024-04-17T14:42:53.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2393 0.67 MB/sec warmup 42 sec latency 248.412 ms 2024-04-17T14:42:54.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2428 0.65 MB/sec warmup 43 sec latency 178.866 ms 2024-04-17T14:42:55.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2441 0.64 MB/sec warmup 44 sec latency 286.060 ms 2024-04-17T14:42:56.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2447 0.62 MB/sec warmup 45 sec latency 695.130 ms 2024-04-17T14:42:57.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2449 0.61 MB/sec warmup 46 sec latency 1659.501 ms 2024-04-17T14:42:58.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2453 0.60 MB/sec warmup 47 sec latency 744.213 ms 2024-04-17T14:42:59.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2497 0.60 MB/sec warmup 48 sec latency 324.534 ms 2024-04-17T14:43:00.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2596 0.59 MB/sec warmup 49 sec latency 189.318 ms 2024-04-17T14:43:01.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:43:01.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:43:01.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2604 0.58 MB/sec warmup 50 sec latency 514.873 ms 2024-04-17T14:43:02.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2759 0.63 MB/sec warmup 51 sec latency 249.531 ms 2024-04-17T14:43:03.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2785 0.61 MB/sec warmup 52 sec latency 193.750 ms 2024-04-17T14:43:04.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2902 0.62 MB/sec warmup 53 sec latency 171.340 ms 2024-04-17T14:43:05.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2934 0.62 MB/sec warmup 54 sec latency 292.610 ms 2024-04-17T14:43:06.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 2989 0.61 MB/sec warmup 55 sec latency 181.351 ms 2024-04-17T14:43:07.920 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3015 0.60 MB/sec warmup 56 sec latency 263.108 ms 2024-04-17T14:43:08.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3176 0.60 MB/sec warmup 57 sec latency 325.993 ms 2024-04-17T14:43:09.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3209 0.59 MB/sec warmup 58 sec latency 193.481 ms 2024-04-17T14:43:10.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3341 0.60 MB/sec warmup 59 sec latency 256.740 ms 2024-04-17T14:43:11.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3359 0.59 MB/sec warmup 60 sec latency 411.883 ms 2024-04-17T14:43:12.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3378 0.58 MB/sec warmup 61 sec latency 442.152 ms 2024-04-17T14:43:13.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3516 0.62 MB/sec warmup 62 sec latency 266.283 ms 2024-04-17T14:43:14.921 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3556 0.61 MB/sec warmup 63 sec latency 204.034 ms 2024-04-17T14:43:15.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3638 0.60 MB/sec warmup 64 sec latency 163.692 ms 2024-04-17T14:43:16.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3671 0.60 MB/sec warmup 65 sec latency 280.545 ms 2024-04-17T14:43:17.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3695 0.59 MB/sec warmup 66 sec latency 214.785 ms 2024-04-17T14:43:18.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3716 0.58 MB/sec warmup 67 sec latency 254.652 ms 2024-04-17T14:43:19.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3773 0.58 MB/sec warmup 68 sec latency 326.230 ms 2024-04-17T14:43:20.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3792 0.58 MB/sec warmup 69 sec latency 183.362 ms 2024-04-17T14:43:21.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3797 0.57 MB/sec warmup 70 sec latency 580.099 ms 2024-04-17T14:43:22.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3805 0.56 MB/sec warmup 71 sec latency 616.636 ms 2024-04-17T14:43:23.922 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3816 0.55 MB/sec warmup 72 sec latency 225.598 ms 2024-04-17T14:43:24.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3820 0.54 MB/sec warmup 73 sec latency 454.752 ms 2024-04-17T14:43:25.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3843 0.54 MB/sec warmup 74 sec latency 452.358 ms 2024-04-17T14:43:26.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3860 0.53 MB/sec warmup 75 sec latency 168.608 ms 2024-04-17T14:43:27.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3884 0.52 MB/sec warmup 76 sec latency 158.938 ms 2024-04-17T14:43:28.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3927 0.52 MB/sec warmup 77 sec latency 236.931 ms 2024-04-17T14:43:29.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3944 0.51 MB/sec warmup 78 sec latency 249.908 ms 2024-04-17T14:43:30.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3963 0.51 MB/sec warmup 79 sec latency 220.455 ms 2024-04-17T14:43:31.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3983 0.50 MB/sec warmup 80 sec latency 183.829 ms 2024-04-17T14:43:31.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:43:31.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:43:32.923 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3998 0.49 MB/sec warmup 81 sec latency 382.121 ms 2024-04-17T14:43:33.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4014 0.49 MB/sec warmup 82 sec latency 259.704 ms 2024-04-17T14:43:34.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4034 0.48 MB/sec warmup 83 sec latency 204.990 ms 2024-04-17T14:43:35.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4105 0.48 MB/sec warmup 84 sec latency 297.796 ms 2024-04-17T14:43:36.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4117 0.47 MB/sec warmup 85 sec latency 310.594 ms 2024-04-17T14:43:37.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4123 0.47 MB/sec warmup 86 sec latency 633.072 ms 2024-04-17T14:43:38.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4141 0.46 MB/sec warmup 87 sec latency 359.956 ms 2024-04-17T14:43:39.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4165 0.46 MB/sec warmup 88 sec latency 122.495 ms 2024-04-17T14:43:40.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4208 0.45 MB/sec warmup 89 sec latency 576.102 ms 2024-04-17T14:43:41.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4270 0.45 MB/sec warmup 90 sec latency 641.923 ms 2024-04-17T14:43:42.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4281 0.44 MB/sec warmup 91 sec latency 895.852 ms 2024-04-17T14:43:43.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4340 0.44 MB/sec warmup 92 sec latency 292.070 ms 2024-04-17T14:43:44.924 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4360 0.44 MB/sec warmup 93 sec latency 431.504 ms 2024-04-17T14:43:45.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4427 0.43 MB/sec warmup 94 sec latency 335.600 ms 2024-04-17T14:43:46.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4472 0.43 MB/sec warmup 95 sec latency 279.935 ms 2024-04-17T14:43:47.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4503 0.43 MB/sec warmup 96 sec latency 313.723 ms 2024-04-17T14:43:48.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4549 0.42 MB/sec warmup 97 sec latency 351.714 ms 2024-04-17T14:43:49.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4618 0.43 MB/sec warmup 98 sec latency 305.268 ms 2024-04-17T14:43:50.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4683 0.43 MB/sec warmup 99 sec latency 314.145 ms 2024-04-17T14:43:51.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4714 0.42 MB/sec warmup 100 sec latency 355.705 ms 2024-04-17T14:43:52.925 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4729 0.42 MB/sec warmup 101 sec latency 655.999 ms 2024-04-17T14:43:53.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4777 0.41 MB/sec warmup 102 sec latency 200.707 ms 2024-04-17T14:43:54.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4818 0.41 MB/sec warmup 103 sec latency 260.265 ms 2024-04-17T14:43:55.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4962 0.43 MB/sec warmup 104 sec latency 145.001 ms 2024-04-17T14:43:56.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4995 0.43 MB/sec warmup 105 sec latency 428.236 ms 2024-04-17T14:43:57.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5055 0.43 MB/sec warmup 106 sec latency 276.349 ms 2024-04-17T14:43:58.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5118 0.42 MB/sec warmup 107 sec latency 157.930 ms 2024-04-17T14:43:59.926 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5168 0.42 MB/sec warmup 108 sec latency 599.852 ms 2024-04-17T14:44:00.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5227 0.42 MB/sec warmup 109 sec latency 370.834 ms 2024-04-17T14:44:01.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5263 0.41 MB/sec warmup 110 sec latency 281.993 ms 2024-04-17T14:44:02.034 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:44:02.038 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:44:02.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5366 0.41 MB/sec warmup 111 sec latency 272.523 ms 2024-04-17T14:44:03.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5476 0.41 MB/sec warmup 112 sec latency 177.234 ms 2024-04-17T14:44:04.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5619 0.40 MB/sec warmup 113 sec latency 242.107 ms 2024-04-17T14:44:05.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5763 0.40 MB/sec warmup 114 sec latency 205.792 ms 2024-04-17T14:44:06.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5893 0.41 MB/sec warmup 115 sec latency 294.471 ms 2024-04-17T14:44:07.927 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5897 0.40 MB/sec warmup 116 sec latency 698.136 ms 2024-04-17T14:44:08.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5927 0.40 MB/sec warmup 117 sec latency 782.348 ms 2024-04-17T14:44:09.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5954 0.40 MB/sec warmup 118 sec latency 260.703 ms 2024-04-17T14:44:10.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5988 0.40 MB/sec warmup 119 sec latency 157.684 ms 2024-04-17T14:44:12.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6027 0.51 MB/sec execute 1 sec latency 388.494 ms 2024-04-17T14:44:13.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6060 0.31 MB/sec execute 2 sec latency 284.288 ms 2024-04-17T14:44:14.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6140 0.28 MB/sec execute 3 sec latency 200.260 ms 2024-04-17T14:44:15.928 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6167 0.22 MB/sec execute 4 sec latency 224.684 ms 2024-04-17T14:44:16.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6339 0.77 MB/sec execute 5 sec latency 183.016 ms 2024-04-17T14:44:17.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6451 0.78 MB/sec execute 6 sec latency 197.609 ms 2024-04-17T14:44:18.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6481 0.77 MB/sec execute 7 sec latency 191.315 ms 2024-04-17T14:44:19.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6537 0.68 MB/sec execute 8 sec latency 276.194 ms 2024-04-17T14:44:20.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6570 0.60 MB/sec execute 9 sec latency 267.588 ms 2024-04-17T14:44:21.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6580 0.54 MB/sec execute 10 sec latency 241.568 ms 2024-04-17T14:44:22.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6726 0.55 MB/sec execute 11 sec latency 336.034 ms 2024-04-17T14:44:23.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6745 0.51 MB/sec execute 12 sec latency 429.850 ms 2024-04-17T14:44:24.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6825 0.55 MB/sec execute 13 sec latency 207.680 ms 2024-04-17T14:44:25.929 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6914 0.52 MB/sec execute 14 sec latency 232.619 ms 2024-04-17T14:44:26.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 6933 0.49 MB/sec execute 15 sec latency 197.686 ms 2024-04-17T14:44:27.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7066 0.64 MB/sec execute 16 sec latency 265.072 ms 2024-04-17T14:44:28.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7091 0.60 MB/sec execute 17 sec latency 446.689 ms 2024-04-17T14:44:29.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7111 0.57 MB/sec execute 18 sec latency 200.818 ms 2024-04-17T14:44:30.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7175 0.55 MB/sec execute 19 sec latency 349.307 ms 2024-04-17T14:44:31.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7190 0.53 MB/sec execute 20 sec latency 261.924 ms 2024-04-17T14:44:32.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:44:32.095 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:44:32.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7209 0.50 MB/sec execute 21 sec latency 320.797 ms 2024-04-17T14:44:33.930 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7234 0.48 MB/sec execute 22 sec latency 283.687 ms 2024-04-17T14:44:34.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7253 0.46 MB/sec execute 23 sec latency 200.858 ms 2024-04-17T14:44:35.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7311 0.49 MB/sec execute 24 sec latency 193.825 ms 2024-04-17T14:44:36.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7328 0.47 MB/sec execute 25 sec latency 298.824 ms 2024-04-17T14:44:37.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7341 0.45 MB/sec execute 26 sec latency 328.971 ms 2024-04-17T14:44:38.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7356 0.43 MB/sec execute 27 sec latency 309.671 ms 2024-04-17T14:44:39.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7363 0.42 MB/sec execute 28 sec latency 777.129 ms 2024-04-17T14:44:40.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7380 0.40 MB/sec execute 29 sec latency 183.742 ms 2024-04-17T14:44:41.931 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7400 0.39 MB/sec execute 30 sec latency 195.303 ms 2024-04-17T14:44:42.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7422 0.38 MB/sec execute 31 sec latency 258.899 ms 2024-04-17T14:44:43.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7444 0.37 MB/sec execute 32 sec latency 380.657 ms 2024-04-17T14:44:44.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7476 0.36 MB/sec execute 33 sec latency 174.071 ms 2024-04-17T14:44:45.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7492 0.35 MB/sec execute 34 sec latency 268.808 ms 2024-04-17T14:44:46.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7502 0.34 MB/sec execute 35 sec latency 447.810 ms 2024-04-17T14:44:47.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7515 0.33 MB/sec execute 36 sec latency 341.116 ms 2024-04-17T14:44:48.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7542 0.32 MB/sec execute 37 sec latency 141.320 ms 2024-04-17T14:44:49.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7566 0.31 MB/sec execute 38 sec latency 199.783 ms 2024-04-17T14:44:50.932 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7585 0.31 MB/sec execute 39 sec latency 275.588 ms 2024-04-17T14:44:51.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7640 0.30 MB/sec execute 40 sec latency 102.247 ms 2024-04-17T14:44:52.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7650 0.29 MB/sec execute 41 sec latency 356.864 ms 2024-04-17T14:44:53.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7658 0.29 MB/sec execute 42 sec latency 412.685 ms 2024-04-17T14:44:54.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7678 0.28 MB/sec execute 43 sec latency 124.882 ms 2024-04-17T14:44:55.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7701 0.27 MB/sec execute 44 sec latency 135.869 ms 2024-04-17T14:44:56.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7721 0.27 MB/sec execute 45 sec latency 448.500 ms 2024-04-17T14:44:57.933 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7768 0.26 MB/sec execute 46 sec latency 645.021 ms 2024-04-17T14:44:58.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7823 0.26 MB/sec execute 47 sec latency 384.183 ms 2024-04-17T14:44:59.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7882 0.26 MB/sec execute 48 sec latency 250.725 ms 2024-04-17T14:45:00.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7924 0.25 MB/sec execute 49 sec latency 429.476 ms 2024-04-17T14:45:01.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7975 0.25 MB/sec execute 50 sec latency 250.845 ms 2024-04-17T14:45:02.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:45:02.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:45:02.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8014 0.25 MB/sec execute 51 sec latency 285.569 ms 2024-04-17T14:45:03.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8025 0.25 MB/sec execute 52 sec latency 803.081 ms 2024-04-17T14:45:04.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8080 0.24 MB/sec execute 53 sec latency 181.008 ms 2024-04-17T14:45:05.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8160 0.26 MB/sec execute 54 sec latency 242.212 ms 2024-04-17T14:45:06.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8209 0.25 MB/sec execute 55 sec latency 185.236 ms 2024-04-17T14:45:07.934 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8265 0.25 MB/sec execute 56 sec latency 230.915 ms 2024-04-17T14:45:08.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8281 0.25 MB/sec execute 57 sec latency 591.193 ms 2024-04-17T14:45:09.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8313 0.24 MB/sec execute 58 sec latency 338.719 ms 2024-04-17T14:45:10.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8360 0.24 MB/sec execute 59 sec latency 169.440 ms 2024-04-17T14:45:11.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8512 0.28 MB/sec execute 60 sec latency 281.869 ms 2024-04-17T14:45:12.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8555 0.28 MB/sec execute 61 sec latency 402.838 ms 2024-04-17T14:45:13.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8608 0.28 MB/sec execute 62 sec latency 487.556 ms 2024-04-17T14:45:14.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8661 0.27 MB/sec execute 63 sec latency 187.225 ms 2024-04-17T14:45:15.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8761 0.27 MB/sec execute 64 sec latency 197.326 ms 2024-04-17T14:45:16.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8806 0.27 MB/sec execute 65 sec latency 271.797 ms 2024-04-17T14:45:17.935 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8928 0.26 MB/sec execute 66 sec latency 253.208 ms 2024-04-17T14:45:18.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9018 0.26 MB/sec execute 67 sec latency 343.716 ms 2024-04-17T14:45:19.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9194 0.26 MB/sec execute 68 sec latency 293.761 ms 2024-04-17T14:45:20.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9363 0.26 MB/sec execute 69 sec latency 220.367 ms 2024-04-17T14:45:21.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9457 0.27 MB/sec execute 70 sec latency 251.812 ms 2024-04-17T14:45:22.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9492 0.27 MB/sec execute 71 sec latency 296.360 ms 2024-04-17T14:45:23.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9510 0.26 MB/sec execute 72 sec latency 526.372 ms 2024-04-17T14:45:24.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9532 0.26 MB/sec execute 73 sec latency 420.528 ms 2024-04-17T14:45:25.936 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9551 0.26 MB/sec execute 74 sec latency 251.265 ms 2024-04-17T14:45:26.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9571 0.26 MB/sec execute 75 sec latency 213.997 ms 2024-04-17T14:45:27.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9601 0.26 MB/sec execute 76 sec latency 262.259 ms 2024-04-17T14:45:28.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9661 0.26 MB/sec execute 77 sec latency 213.742 ms 2024-04-17T14:45:29.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9685 0.26 MB/sec execute 78 sec latency 314.237 ms 2024-04-17T14:45:30.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9710 0.25 MB/sec execute 79 sec latency 221.105 ms 2024-04-17T14:45:31.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9861 0.29 MB/sec execute 80 sec latency 225.339 ms 2024-04-17T14:45:32.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:45:32.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:45:32.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9896 0.28 MB/sec execute 81 sec latency 189.536 ms 2024-04-17T14:45:33.937 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9980 0.28 MB/sec execute 82 sec latency 502.994 ms 2024-04-17T14:45:34.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10030 0.30 MB/sec execute 83 sec latency 167.561 ms 2024-04-17T14:45:35.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10072 0.29 MB/sec execute 84 sec latency 369.614 ms 2024-04-17T14:45:36.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10101 0.29 MB/sec execute 85 sec latency 160.922 ms 2024-04-17T14:45:37.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10123 0.29 MB/sec execute 86 sec latency 439.607 ms 2024-04-17T14:45:38.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10288 0.29 MB/sec execute 87 sec latency 186.920 ms 2024-04-17T14:45:39.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10323 0.29 MB/sec execute 88 sec latency 340.969 ms 2024-04-17T14:45:40.938 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10452 0.30 MB/sec execute 89 sec latency 282.882 ms 2024-04-17T14:45:41.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10477 0.29 MB/sec execute 90 sec latency 172.294 ms 2024-04-17T14:45:42.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10604 0.32 MB/sec execute 91 sec latency 248.651 ms 2024-04-17T14:45:43.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10621 0.32 MB/sec execute 92 sec latency 439.388 ms 2024-04-17T14:45:44.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10644 0.32 MB/sec execute 93 sec latency 383.134 ms 2024-04-17T14:45:45.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10718 0.31 MB/sec execute 94 sec latency 298.343 ms 2024-04-17T14:45:46.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10730 0.31 MB/sec execute 95 sec latency 342.268 ms 2024-04-17T14:45:47.939 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10754 0.31 MB/sec execute 96 sec latency 377.241 ms 2024-04-17T14:45:48.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10766 0.31 MB/sec execute 97 sec latency 236.365 ms 2024-04-17T14:45:49.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10787 0.30 MB/sec execute 98 sec latency 244.022 ms 2024-04-17T14:45:50.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10813 0.30 MB/sec execute 99 sec latency 239.259 ms 2024-04-17T14:45:51.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10870 0.31 MB/sec execute 100 sec latency 232.070 ms 2024-04-17T14:45:52.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10875 0.30 MB/sec execute 101 sec latency 513.777 ms 2024-04-17T14:45:53.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10887 0.30 MB/sec execute 102 sec latency 441.995 ms 2024-04-17T14:45:54.940 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10902 0.30 MB/sec execute 103 sec latency 284.584 ms 2024-04-17T14:45:55.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10925 0.30 MB/sec execute 104 sec latency 176.484 ms 2024-04-17T14:45:56.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10946 0.29 MB/sec execute 105 sec latency 159.209 ms 2024-04-17T14:45:57.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10968 0.29 MB/sec execute 106 sec latency 188.307 ms 2024-04-17T14:45:58.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 10990 0.29 MB/sec execute 107 sec latency 305.521 ms 2024-04-17T14:45:59.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11017 0.29 MB/sec execute 108 sec latency 345.834 ms 2024-04-17T14:46:00.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11032 0.29 MB/sec execute 109 sec latency 453.911 ms 2024-04-17T14:46:01.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11048 0.28 MB/sec execute 110 sec latency 215.975 ms 2024-04-17T14:46:02.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:46:02.331 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:46:02.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11065 0.28 MB/sec execute 111 sec latency 201.656 ms 2024-04-17T14:46:03.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11077 0.28 MB/sec execute 112 sec latency 308.935 ms 2024-04-17T14:46:04.941 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11100 0.27 MB/sec execute 113 sec latency 128.359 ms 2024-04-17T14:46:05.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11121 0.27 MB/sec execute 114 sec latency 221.698 ms 2024-04-17T14:46:06.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11180 0.27 MB/sec execute 115 sec latency 234.742 ms 2024-04-17T14:46:07.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11195 0.27 MB/sec execute 116 sec latency 113.989 ms 2024-04-17T14:46:08.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11206 0.27 MB/sec execute 117 sec latency 297.808 ms 2024-04-17T14:46:09.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11216 0.26 MB/sec execute 118 sec latency 376.534 ms 2024-04-17T14:46:10.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11242 0.26 MB/sec execute 119 sec latency 165.744 ms 2024-04-17T14:46:11.942 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11297 0.26 MB/sec execute 120 sec latency 132.983 ms 2024-04-17T14:46:12.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11313 0.26 MB/sec execute 121 sec latency 873.220 ms 2024-04-17T14:46:13.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11359 0.26 MB/sec execute 122 sec latency 283.244 ms 2024-04-17T14:46:14.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11381 0.26 MB/sec execute 123 sec latency 431.098 ms 2024-04-17T14:46:15.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11438 0.25 MB/sec execute 124 sec latency 413.342 ms 2024-04-17T14:46:16.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11475 0.25 MB/sec execute 125 sec latency 337.624 ms 2024-04-17T14:46:17.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11532 0.25 MB/sec execute 126 sec latency 298.657 ms 2024-04-17T14:46:18.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11561 0.25 MB/sec execute 127 sec latency 478.956 ms 2024-04-17T14:46:19.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11592 0.25 MB/sec execute 128 sec latency 485.602 ms 2024-04-17T14:46:20.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11627 0.25 MB/sec execute 129 sec latency 366.752 ms 2024-04-17T14:46:21.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11668 0.25 MB/sec execute 130 sec latency 371.395 ms 2024-04-17T14:46:22.943 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11720 0.25 MB/sec execute 131 sec latency 195.636 ms 2024-04-17T14:46:23.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11756 0.25 MB/sec execute 132 sec latency 445.580 ms 2024-04-17T14:46:24.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11803 0.25 MB/sec execute 133 sec latency 310.132 ms 2024-04-17T14:46:25.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11836 0.25 MB/sec execute 134 sec latency 252.765 ms 2024-04-17T14:46:26.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11900 0.25 MB/sec execute 135 sec latency 235.244 ms 2024-04-17T14:46:27.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12050 0.27 MB/sec execute 136 sec latency 243.030 ms 2024-04-17T14:46:28.944 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12084 0.26 MB/sec execute 137 sec latency 448.465 ms 2024-04-17T14:46:29.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12118 0.26 MB/sec execute 138 sec latency 354.814 ms 2024-04-17T14:46:30.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12172 0.26 MB/sec execute 139 sec latency 135.601 ms 2024-04-17T14:46:31.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12258 0.26 MB/sec execute 140 sec latency 182.712 ms 2024-04-17T14:46:32.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:46:32.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:46:32.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12335 0.26 MB/sec execute 141 sec latency 206.310 ms 2024-04-17T14:46:33.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12344 0.26 MB/sec execute 142 sec latency 535.274 ms 2024-04-17T14:46:34.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12425 0.25 MB/sec execute 143 sec latency 419.395 ms 2024-04-17T14:46:35.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12546 0.25 MB/sec execute 144 sec latency 322.738 ms 2024-04-17T14:46:36.945 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12646 0.25 MB/sec execute 145 sec latency 228.567 ms 2024-04-17T14:46:37.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12856 0.25 MB/sec execute 146 sec latency 200.123 ms 2024-04-17T14:46:38.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12962 0.26 MB/sec execute 147 sec latency 226.160 ms 2024-04-17T14:46:39.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13022 0.26 MB/sec execute 148 sec latency 148.075 ms 2024-04-17T14:46:40.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13048 0.26 MB/sec execute 149 sec latency 349.010 ms 2024-04-17T14:46:41.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13070 0.25 MB/sec execute 150 sec latency 470.968 ms 2024-04-17T14:46:42.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13095 0.25 MB/sec execute 151 sec latency 317.399 ms 2024-04-17T14:46:43.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13108 0.25 MB/sec execute 152 sec latency 437.086 ms 2024-04-17T14:46:44.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13143 0.25 MB/sec execute 153 sec latency 361.248 ms 2024-04-17T14:46:45.946 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13214 0.25 MB/sec execute 154 sec latency 261.994 ms 2024-04-17T14:46:46.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13248 0.25 MB/sec execute 155 sec latency 271.610 ms 2024-04-17T14:46:47.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13403 0.27 MB/sec execute 156 sec latency 338.882 ms 2024-04-17T14:46:48.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13437 0.27 MB/sec execute 157 sec latency 184.873 ms 2024-04-17T14:46:49.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13548 0.27 MB/sec execute 158 sec latency 191.023 ms 2024-04-17T14:46:50.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13581 0.27 MB/sec execute 159 sec latency 237.917 ms 2024-04-17T14:46:51.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13643 0.27 MB/sec execute 160 sec latency 256.584 ms 2024-04-17T14:46:52.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13673 0.27 MB/sec execute 161 sec latency 227.856 ms 2024-04-17T14:46:53.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13826 0.27 MB/sec execute 162 sec latency 303.259 ms 2024-04-17T14:46:54.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13854 0.27 MB/sec execute 163 sec latency 340.424 ms 2024-04-17T14:46:55.947 INFO:tasks.workunit.client.0.smithi016.stdout: 1 13990 0.28 MB/sec execute 164 sec latency 394.470 ms 2024-04-17T14:46:56.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14013 0.28 MB/sec execute 165 sec latency 210.913 ms 2024-04-17T14:46:57.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14046 0.27 MB/sec execute 166 sec latency 194.782 ms 2024-04-17T14:46:58.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14179 0.29 MB/sec execute 167 sec latency 468.437 ms 2024-04-17T14:46:59.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14202 0.29 MB/sec execute 168 sec latency 361.180 ms 2024-04-17T14:47:00.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14259 0.29 MB/sec execute 169 sec latency 251.297 ms 2024-04-17T14:47:01.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14282 0.29 MB/sec execute 170 sec latency 388.913 ms 2024-04-17T14:47:02.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:47:02.443 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:47:02.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14305 0.29 MB/sec execute 171 sec latency 222.419 ms 2024-04-17T14:47:03.948 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14315 0.28 MB/sec execute 172 sec latency 371.223 ms 2024-04-17T14:47:04.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14315 0.28 MB/sec execute 173 sec latency 1371.361 ms 2024-04-17T14:47:05.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14336 0.28 MB/sec execute 174 sec latency 1399.977 ms 2024-04-17T14:47:06.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14370 0.28 MB/sec execute 175 sec latency 161.283 ms 2024-04-17T14:47:07.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14415 0.28 MB/sec execute 176 sec latency 292.343 ms 2024-04-17T14:47:08.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14431 0.28 MB/sec execute 177 sec latency 283.220 ms 2024-04-17T14:47:09.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14440 0.28 MB/sec execute 178 sec latency 395.818 ms 2024-04-17T14:47:10.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14466 0.28 MB/sec execute 179 sec latency 307.670 ms 2024-04-17T14:47:11.949 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14491 0.28 MB/sec execute 180 sec latency 148.199 ms 2024-04-17T14:47:12.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14517 0.28 MB/sec execute 181 sec latency 148.096 ms 2024-04-17T14:47:13.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14541 0.28 MB/sec execute 182 sec latency 206.162 ms 2024-04-17T14:47:14.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14566 0.27 MB/sec execute 183 sec latency 342.871 ms 2024-04-17T14:47:15.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14571 0.27 MB/sec execute 184 sec latency 343.633 ms 2024-04-17T14:47:16.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14587 0.27 MB/sec execute 185 sec latency 336.821 ms 2024-04-17T14:47:17.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14606 0.27 MB/sec execute 186 sec latency 300.582 ms 2024-04-17T14:47:18.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14630 0.27 MB/sec execute 187 sec latency 155.981 ms 2024-04-17T14:47:19.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14652 0.27 MB/sec execute 188 sec latency 160.689 ms 2024-04-17T14:47:20.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14667 0.27 MB/sec execute 189 sec latency 206.300 ms 2024-04-17T14:47:21.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14700 0.26 MB/sec execute 190 sec latency 293.617 ms 2024-04-17T14:47:22.950 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14742 0.26 MB/sec execute 191 sec latency 131.100 ms 2024-04-17T14:47:23.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14756 0.26 MB/sec execute 192 sec latency 249.853 ms 2024-04-17T14:47:24.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14762 0.26 MB/sec execute 193 sec latency 618.352 ms 2024-04-17T14:47:25.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14783 0.26 MB/sec execute 194 sec latency 180.605 ms 2024-04-17T14:47:26.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14815 0.26 MB/sec execute 195 sec latency 120.250 ms 2024-04-17T14:47:27.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14862 0.26 MB/sec execute 196 sec latency 751.364 ms 2024-04-17T14:47:28.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14917 0.26 MB/sec execute 197 sec latency 335.732 ms 2024-04-17T14:47:29.951 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14976 0.26 MB/sec execute 198 sec latency 299.877 ms 2024-04-17T14:47:30.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14987 0.25 MB/sec execute 199 sec latency 579.499 ms 2024-04-17T14:47:31.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15022 0.25 MB/sec execute 200 sec latency 307.926 ms 2024-04-17T14:47:32.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:47:32.507 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:47:32.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15104 0.25 MB/sec execute 201 sec latency 271.493 ms 2024-04-17T14:47:33.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15132 0.25 MB/sec execute 202 sec latency 305.889 ms 2024-04-17T14:47:34.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15174 0.25 MB/sec execute 203 sec latency 391.274 ms 2024-04-17T14:47:35.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15203 0.25 MB/sec execute 204 sec latency 323.313 ms 2024-04-17T14:47:36.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15263 0.25 MB/sec execute 205 sec latency 195.248 ms 2024-04-17T14:47:37.952 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15319 0.25 MB/sec execute 206 sec latency 208.848 ms 2024-04-17T14:47:38.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15350 0.25 MB/sec execute 207 sec latency 532.518 ms 2024-04-17T14:47:39.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15382 0.25 MB/sec execute 208 sec latency 213.024 ms 2024-04-17T14:47:40.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15433 0.25 MB/sec execute 209 sec latency 203.291 ms 2024-04-17T14:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15580 0.26 MB/sec execute 210 sec latency 230.586 ms 2024-04-17T14:47:42.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15631 0.26 MB/sec execute 211 sec latency 367.362 ms 2024-04-17T14:47:43.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15688 0.26 MB/sec execute 212 sec latency 212.180 ms 2024-04-17T14:47:44.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15714 0.26 MB/sec execute 213 sec latency 555.017 ms 2024-04-17T14:47:45.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15804 0.26 MB/sec execute 214 sec latency 162.162 ms 2024-04-17T14:47:46.953 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15835 0.26 MB/sec execute 215 sec latency 191.964 ms 2024-04-17T14:47:47.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15883 0.26 MB/sec execute 216 sec latency 301.858 ms 2024-04-17T14:47:48.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15901 0.26 MB/sec execute 217 sec latency 337.779 ms 2024-04-17T14:47:49.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16004 0.25 MB/sec execute 218 sec latency 219.945 ms 2024-04-17T14:47:50.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16039 0.25 MB/sec execute 219 sec latency 278.596 ms 2024-04-17T14:47:51.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16065 0.25 MB/sec execute 220 sec latency 259.572 ms 2024-04-17T14:47:52.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16110 0.25 MB/sec execute 221 sec latency 208.205 ms 2024-04-17T14:47:53.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16174 0.25 MB/sec execute 222 sec latency 321.801 ms 2024-04-17T14:47:54.954 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16231 0.25 MB/sec execute 223 sec latency 328.622 ms 2024-04-17T14:47:55.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16372 0.25 MB/sec execute 224 sec latency 360.578 ms 2024-04-17T14:47:56.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16492 0.25 MB/sec execute 225 sec latency 170.514 ms 2024-04-17T14:47:57.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16549 0.25 MB/sec execute 226 sec latency 333.562 ms 2024-04-17T14:47:58.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16595 0.25 MB/sec execute 227 sec latency 307.904 ms 2024-04-17T14:47:59.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16624 0.25 MB/sec execute 228 sec latency 183.082 ms 2024-04-17T14:48:00.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16645 0.25 MB/sec execute 229 sec latency 348.196 ms 2024-04-17T14:48:01.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16673 0.25 MB/sec execute 230 sec latency 457.968 ms 2024-04-17T14:48:02.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:48:02.563 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:48:02.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16704 0.25 MB/sec execute 231 sec latency 255.925 ms 2024-04-17T14:48:03.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16777 0.25 MB/sec execute 232 sec latency 231.319 ms 2024-04-17T14:48:04.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16802 0.25 MB/sec execute 233 sec latency 319.478 ms 2024-04-17T14:48:05.955 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16961 0.26 MB/sec execute 234 sec latency 171.736 ms 2024-04-17T14:48:06.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17073 0.26 MB/sec execute 235 sec latency 173.915 ms 2024-04-17T14:48:07.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17118 0.27 MB/sec execute 236 sec latency 179.637 ms 2024-04-17T14:48:08.811 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:09:33.181 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:08.898 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:09:33.268 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:08.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17174 0.26 MB/sec execute 237 sec latency 381.784 ms 2024-04-17T14:48:09.047 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:09:33.368 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.065 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:09:33.375 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.137 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:09:33.458 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.164 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:09:33.474 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.307 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:09:33.676 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.678 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:09:33.999 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.699 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:09:34.009 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:48:09.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17208 0.26 MB/sec execute 238 sec latency 241.267 ms 2024-04-17T14:48:10.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17368 0.27 MB/sec execute 239 sec latency 489.713 ms 2024-04-17T14:48:11.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17401 0.26 MB/sec execute 240 sec latency 237.434 ms 2024-04-17T14:48:12.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17466 0.27 MB/sec execute 241 sec latency 711.270 ms 2024-04-17T14:48:13.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17551 0.27 MB/sec execute 242 sec latency 240.853 ms 2024-04-17T14:48:14.956 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17564 0.27 MB/sec execute 243 sec latency 303.343 ms 2024-04-17T14:48:15.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17694 0.28 MB/sec execute 244 sec latency 161.065 ms 2024-04-17T14:48:16.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17722 0.28 MB/sec execute 245 sec latency 417.552 ms 2024-04-17T14:48:17.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17737 0.28 MB/sec execute 246 sec latency 360.353 ms 2024-04-17T14:48:18.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17752 0.27 MB/sec execute 247 sec latency 264.474 ms 2024-04-17T14:48:19.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17812 0.27 MB/sec execute 248 sec latency 249.886 ms 2024-04-17T14:48:20.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17829 0.27 MB/sec execute 249 sec latency 301.588 ms 2024-04-17T14:48:21.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17857 0.27 MB/sec execute 250 sec latency 221.016 ms 2024-04-17T14:48:22.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17885 0.27 MB/sec execute 251 sec latency 301.734 ms 2024-04-17T14:48:23.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17899 0.27 MB/sec execute 252 sec latency 382.034 ms 2024-04-17T14:48:24.957 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17917 0.27 MB/sec execute 253 sec latency 542.703 ms 2024-04-17T14:48:25.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17959 0.27 MB/sec execute 254 sec latency 290.914 ms 2024-04-17T14:48:26.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17975 0.27 MB/sec execute 255 sec latency 259.396 ms 2024-04-17T14:48:27.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17988 0.27 MB/sec execute 256 sec latency 287.935 ms 2024-04-17T14:48:28.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 17996 0.27 MB/sec execute 257 sec latency 329.169 ms 2024-04-17T14:48:29.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18010 0.27 MB/sec execute 258 sec latency 192.548 ms 2024-04-17T14:48:30.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18022 0.27 MB/sec execute 259 sec latency 169.840 ms 2024-04-17T14:48:31.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18036 0.27 MB/sec execute 260 sec latency 184.514 ms 2024-04-17T14:48:32.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:48:32.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:48:32.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18047 0.26 MB/sec execute 261 sec latency 279.861 ms 2024-04-17T14:48:33.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18063 0.26 MB/sec execute 262 sec latency 183.426 ms 2024-04-17T14:48:34.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18080 0.26 MB/sec execute 263 sec latency 364.405 ms 2024-04-17T14:48:35.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18104 0.26 MB/sec execute 264 sec latency 157.808 ms 2024-04-17T14:48:36.958 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18118 0.26 MB/sec execute 265 sec latency 252.637 ms 2024-04-17T14:48:37.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18127 0.26 MB/sec execute 266 sec latency 387.914 ms 2024-04-17T14:48:38.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18142 0.26 MB/sec execute 267 sec latency 377.493 ms 2024-04-17T14:48:39.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18159 0.26 MB/sec execute 268 sec latency 195.356 ms 2024-04-17T14:48:40.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18182 0.26 MB/sec execute 269 sec latency 142.650 ms 2024-04-17T14:48:41.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18204 0.26 MB/sec execute 270 sec latency 188.715 ms 2024-04-17T14:48:42.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18222 0.26 MB/sec execute 271 sec latency 203.644 ms 2024-04-17T14:48:43.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18273 0.25 MB/sec execute 272 sec latency 146.611 ms 2024-04-17T14:48:44.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18280 0.25 MB/sec execute 273 sec latency 244.323 ms 2024-04-17T14:48:45.959 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18301 0.25 MB/sec execute 274 sec latency 215.771 ms 2024-04-17T14:48:46.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18318 0.25 MB/sec execute 275 sec latency 427.257 ms 2024-04-17T14:48:47.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18339 0.25 MB/sec execute 276 sec latency 268.028 ms 2024-04-17T14:48:48.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18392 0.25 MB/sec execute 277 sec latency 178.704 ms 2024-04-17T14:48:49.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18393 0.25 MB/sec execute 278 sec latency 897.674 ms 2024-04-17T14:48:50.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18454 0.25 MB/sec execute 279 sec latency 421.320 ms 2024-04-17T14:48:51.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18495 0.25 MB/sec execute 280 sec latency 568.070 ms 2024-04-17T14:48:52.960 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18529 0.25 MB/sec execute 281 sec latency 307.923 ms 2024-04-17T14:48:53.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18544 0.25 MB/sec execute 282 sec latency 629.077 ms 2024-04-17T14:48:54.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18600 0.25 MB/sec execute 283 sec latency 414.151 ms 2024-04-17T14:48:55.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18652 0.25 MB/sec execute 284 sec latency 224.515 ms 2024-04-17T14:48:56.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18687 0.25 MB/sec execute 285 sec latency 355.309 ms 2024-04-17T14:48:57.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18722 0.25 MB/sec execute 286 sec latency 442.030 ms 2024-04-17T14:48:58.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18789 0.25 MB/sec execute 287 sec latency 290.817 ms 2024-04-17T14:48:59.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18815 0.25 MB/sec execute 288 sec latency 289.133 ms 2024-04-17T14:49:00.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18879 0.25 MB/sec execute 289 sec latency 234.478 ms 2024-04-17T14:49:01.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18922 0.25 MB/sec execute 290 sec latency 337.719 ms 2024-04-17T14:49:02.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:49:02.810 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:49:02.961 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18955 0.25 MB/sec execute 291 sec latency 265.250 ms 2024-04-17T14:49:03.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18994 0.24 MB/sec execute 292 sec latency 215.608 ms 2024-04-17T14:49:04.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19129 0.25 MB/sec execute 293 sec latency 289.708 ms 2024-04-17T14:49:05.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19154 0.25 MB/sec execute 294 sec latency 496.273 ms 2024-04-17T14:49:06.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19197 0.25 MB/sec execute 295 sec latency 261.689 ms 2024-04-17T14:49:07.962 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19267 0.25 MB/sec execute 296 sec latency 215.149 ms 2024-04-17T14:49:08.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19353 0.25 MB/sec execute 297 sec latency 182.101 ms 2024-04-17T14:49:09.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19430 0.25 MB/sec execute 298 sec latency 217.289 ms 2024-04-17T14:49:10.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19508 0.25 MB/sec execute 299 sec latency 348.660 ms 2024-04-17T14:49:11.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19571 0.25 MB/sec execute 300 sec latency 257.667 ms 2024-04-17T14:49:12.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19639 0.25 MB/sec execute 301 sec latency 450.610 ms 2024-04-17T14:49:13.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19805 0.25 MB/sec execute 302 sec latency 231.695 ms 2024-04-17T14:49:14.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 19969 0.25 MB/sec execute 303 sec latency 327.044 ms 2024-04-17T14:49:15.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20090 0.25 MB/sec execute 304 sec latency 250.909 ms 2024-04-17T14:49:16.963 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20143 0.25 MB/sec execute 305 sec latency 246.472 ms 2024-04-17T14:49:17.964 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20173 0.25 MB/sec execute 306 sec latency 363.563 ms 2024-04-17T14:49:18.964 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20192 0.25 MB/sec execute 307 sec latency 254.240 ms 2024-04-17T14:49:19.964 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20224 0.25 MB/sec execute 308 sec latency 339.160 ms 2024-04-17T14:49:20.964 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20251 0.25 MB/sec execute 309 sec latency 177.220 ms 2024-04-17T14:49:21.964 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20284 0.25 MB/sec execute 310 sec latency 272.417 ms 2024-04-17T14:49:22.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20342 0.25 MB/sec execute 311 sec latency 329.815 ms 2024-04-17T14:49:23.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20366 0.25 MB/sec execute 312 sec latency 419.250 ms 2024-04-17T14:49:24.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20391 0.25 MB/sec execute 313 sec latency 327.734 ms 2024-04-17T14:49:25.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20542 0.26 MB/sec execute 314 sec latency 375.829 ms 2024-04-17T14:49:26.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20675 0.26 MB/sec execute 315 sec latency 148.570 ms 2024-04-17T14:49:27.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20706 0.26 MB/sec execute 316 sec latency 160.013 ms 2024-04-17T14:49:28.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20755 0.26 MB/sec execute 317 sec latency 414.217 ms 2024-04-17T14:49:29.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20787 0.26 MB/sec execute 318 sec latency 142.913 ms 2024-04-17T14:49:30.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20951 0.26 MB/sec execute 319 sec latency 294.131 ms 2024-04-17T14:49:31.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20984 0.26 MB/sec execute 320 sec latency 163.553 ms 2024-04-17T14:49:32.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:49:32.865 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:49:32.965 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21120 0.26 MB/sec execute 321 sec latency 226.058 ms 2024-04-17T14:49:33.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21138 0.26 MB/sec execute 322 sec latency 317.570 ms 2024-04-17T14:49:34.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21157 0.26 MB/sec execute 323 sec latency 223.473 ms 2024-04-17T14:49:35.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21271 0.27 MB/sec execute 324 sec latency 286.699 ms 2024-04-17T14:49:36.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21303 0.27 MB/sec execute 325 sec latency 294.883 ms 2024-04-17T14:49:37.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21323 0.27 MB/sec execute 326 sec latency 297.603 ms 2024-04-17T14:49:38.966 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21338 0.27 MB/sec execute 327 sec latency 246.767 ms 2024-04-17T14:49:39.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21398 0.27 MB/sec execute 328 sec latency 215.967 ms 2024-04-17T14:49:40.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21416 0.26 MB/sec execute 329 sec latency 282.515 ms 2024-04-17T14:49:41.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21444 0.26 MB/sec execute 330 sec latency 213.855 ms 2024-04-17T14:49:42.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21465 0.26 MB/sec execute 331 sec latency 220.130 ms 2024-04-17T14:49:43.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21486 0.26 MB/sec execute 332 sec latency 251.309 ms 2024-04-17T14:49:44.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21537 0.26 MB/sec execute 333 sec latency 481.286 ms 2024-04-17T14:49:45.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21542 0.26 MB/sec execute 334 sec latency 783.617 ms 2024-04-17T14:49:46.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21554 0.26 MB/sec execute 335 sec latency 468.425 ms 2024-04-17T14:49:47.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21570 0.26 MB/sec execute 336 sec latency 292.760 ms 2024-04-17T14:49:48.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21581 0.26 MB/sec execute 337 sec latency 295.203 ms 2024-04-17T14:49:49.967 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21605 0.26 MB/sec execute 338 sec latency 272.938 ms 2024-04-17T14:49:50.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21628 0.26 MB/sec execute 339 sec latency 178.527 ms 2024-04-17T14:49:51.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21649 0.26 MB/sec execute 340 sec latency 197.500 ms 2024-04-17T14:49:52.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21692 0.26 MB/sec execute 341 sec latency 182.910 ms 2024-04-17T14:49:53.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21704 0.26 MB/sec execute 342 sec latency 261.039 ms 2024-04-17T14:49:54.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21713 0.26 MB/sec execute 343 sec latency 448.701 ms 2024-04-17T14:49:55.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21724 0.26 MB/sec execute 344 sec latency 622.064 ms 2024-04-17T14:49:56.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21744 0.26 MB/sec execute 345 sec latency 168.893 ms 2024-04-17T14:49:57.968 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21768 0.26 MB/sec execute 346 sec latency 144.799 ms 2024-04-17T14:49:58.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21787 0.25 MB/sec execute 347 sec latency 240.276 ms 2024-04-17T14:49:59.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21807 0.25 MB/sec execute 348 sec latency 197.861 ms 2024-04-17T14:50:00.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21866 0.25 MB/sec execute 349 sec latency 120.965 ms 2024-04-17T14:50:01.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21892 0.25 MB/sec execute 350 sec latency 135.220 ms 2024-04-17T14:50:02.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:50:02.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:50:02.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21917 0.25 MB/sec execute 351 sec latency 125.664 ms 2024-04-17T14:50:03.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21933 0.25 MB/sec execute 352 sec latency 190.067 ms 2024-04-17T14:50:04.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21973 0.25 MB/sec execute 353 sec latency 602.054 ms 2024-04-17T14:50:05.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21986 0.25 MB/sec execute 354 sec latency 902.949 ms 2024-04-17T14:50:06.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22022 0.25 MB/sec execute 355 sec latency 329.976 ms 2024-04-17T14:50:07.969 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22048 0.25 MB/sec execute 356 sec latency 386.860 ms 2024-04-17T14:50:08.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22109 0.25 MB/sec execute 357 sec latency 538.408 ms 2024-04-17T14:50:09.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22125 0.25 MB/sec execute 358 sec latency 504.254 ms 2024-04-17T14:50:10.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22196 0.25 MB/sec execute 359 sec latency 251.245 ms 2024-04-17T14:50:11.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22237 0.25 MB/sec execute 360 sec latency 262.792 ms 2024-04-17T14:50:12.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22269 0.25 MB/sec execute 361 sec latency 310.971 ms 2024-04-17T14:50:13.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22304 0.25 MB/sec execute 362 sec latency 372.475 ms 2024-04-17T14:50:14.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22383 0.25 MB/sec execute 363 sec latency 242.347 ms 2024-04-17T14:50:15.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22397 0.25 MB/sec execute 364 sec latency 285.011 ms 2024-04-17T14:50:16.970 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22450 0.25 MB/sec execute 365 sec latency 254.463 ms 2024-04-17T14:50:17.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22503 0.25 MB/sec execute 366 sec latency 213.767 ms 2024-04-17T14:50:18.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22542 0.25 MB/sec execute 367 sec latency 270.168 ms 2024-04-17T14:50:19.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22582 0.25 MB/sec execute 368 sec latency 302.532 ms 2024-04-17T14:50:20.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22725 0.25 MB/sec execute 369 sec latency 235.047 ms 2024-04-17T14:50:21.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22759 0.25 MB/sec execute 370 sec latency 243.361 ms 2024-04-17T14:50:22.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22817 0.25 MB/sec execute 371 sec latency 288.010 ms 2024-04-17T14:50:23.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22854 0.25 MB/sec execute 372 sec latency 218.084 ms 2024-04-17T14:50:24.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22933 0.25 MB/sec execute 373 sec latency 375.391 ms 2024-04-17T14:50:25.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 22973 0.25 MB/sec execute 374 sec latency 516.126 ms 2024-04-17T14:50:26.971 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23016 0.25 MB/sec execute 375 sec latency 517.817 ms 2024-04-17T14:50:27.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23132 0.25 MB/sec execute 376 sec latency 295.446 ms 2024-04-17T14:50:28.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23218 0.25 MB/sec execute 377 sec latency 388.236 ms 2024-04-17T14:50:29.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23303 0.25 MB/sec execute 378 sec latency 289.667 ms 2024-04-17T14:50:30.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23505 0.25 MB/sec execute 379 sec latency 293.832 ms 2024-04-17T14:50:31.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23659 0.25 MB/sec execute 380 sec latency 137.653 ms 2024-04-17T14:50:32.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23702 0.25 MB/sec execute 381 sec latency 301.937 ms 2024-04-17T14:50:32.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:50:33.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:50:33.972 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23732 0.25 MB/sec execute 382 sec latency 197.513 ms 2024-04-17T14:50:34.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23762 0.25 MB/sec execute 383 sec latency 319.523 ms 2024-04-17T14:50:35.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23779 0.25 MB/sec execute 384 sec latency 214.686 ms 2024-04-17T14:50:36.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23815 0.25 MB/sec execute 385 sec latency 399.347 ms 2024-04-17T14:50:37.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23895 0.25 MB/sec execute 386 sec latency 286.497 ms 2024-04-17T14:50:38.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23921 0.25 MB/sec execute 387 sec latency 285.000 ms 2024-04-17T14:50:39.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23927 0.25 MB/sec execute 388 sec latency 1233.039 ms 2024-04-17T14:50:40.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23981 0.25 MB/sec execute 389 sec latency 289.861 ms 2024-04-17T14:50:41.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24085 0.26 MB/sec execute 390 sec latency 334.446 ms 2024-04-17T14:50:42.973 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24202 0.26 MB/sec execute 391 sec latency 221.667 ms 2024-04-17T14:50:43.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24226 0.26 MB/sec execute 392 sec latency 297.225 ms 2024-04-17T14:50:44.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24266 0.26 MB/sec execute 393 sec latency 274.247 ms 2024-04-17T14:50:45.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24312 0.26 MB/sec execute 394 sec latency 250.708 ms 2024-04-17T14:50:46.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24335 0.26 MB/sec execute 395 sec latency 255.619 ms 2024-04-17T14:50:47.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24492 0.26 MB/sec execute 396 sec latency 266.370 ms 2024-04-17T14:50:48.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24520 0.26 MB/sec execute 397 sec latency 240.395 ms 2024-04-17T14:50:49.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24619 0.26 MB/sec execute 398 sec latency 335.564 ms 2024-04-17T14:50:50.974 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24684 0.26 MB/sec execute 399 sec latency 197.118 ms 2024-04-17T14:50:51.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24701 0.26 MB/sec execute 400 sec latency 181.723 ms 2024-04-17T14:50:52.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24846 0.26 MB/sec execute 401 sec latency 265.749 ms 2024-04-17T14:50:53.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24877 0.26 MB/sec execute 402 sec latency 327.897 ms 2024-04-17T14:50:54.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24943 0.26 MB/sec execute 403 sec latency 429.522 ms 2024-04-17T14:50:55.671 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:12:20.040 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.683 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:12:20.052 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.734 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:12:20.054 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.740 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:12:20.049 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.747 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:12:20.068 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.749 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:12:20.059 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.783 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:12:20.152 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.883 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:12:20.204 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.923 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:12:20.232 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:50:55.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24967 0.26 MB/sec execute 404 sec latency 191.313 ms 2024-04-17T14:50:56.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24992 0.26 MB/sec execute 405 sec latency 233.867 ms 2024-04-17T14:50:57.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25017 0.26 MB/sec execute 406 sec latency 216.054 ms 2024-04-17T14:50:58.975 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25083 0.26 MB/sec execute 407 sec latency 200.693 ms 2024-04-17T14:50:59.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25096 0.26 MB/sec execute 408 sec latency 387.875 ms 2024-04-17T14:51:00.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25112 0.26 MB/sec execute 409 sec latency 305.561 ms 2024-04-17T14:51:01.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25127 0.26 MB/sec execute 410 sec latency 220.822 ms 2024-04-17T14:51:02.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25151 0.26 MB/sec execute 411 sec latency 182.673 ms 2024-04-17T14:51:03.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:51:03.068 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:51:03.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25175 0.26 MB/sec execute 412 sec latency 184.672 ms 2024-04-17T14:51:04.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25199 0.26 MB/sec execute 413 sec latency 220.632 ms 2024-04-17T14:51:05.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25235 0.26 MB/sec execute 414 sec latency 299.713 ms 2024-04-17T14:51:06.976 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25246 0.26 MB/sec execute 415 sec latency 332.306 ms 2024-04-17T14:51:07.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25259 0.26 MB/sec execute 416 sec latency 301.435 ms 2024-04-17T14:51:08.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25278 0.26 MB/sec execute 417 sec latency 340.685 ms 2024-04-17T14:51:09.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25290 0.26 MB/sec execute 418 sec latency 294.434 ms 2024-04-17T14:51:10.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25314 0.26 MB/sec execute 419 sec latency 150.634 ms 2024-04-17T14:51:11.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25336 0.26 MB/sec execute 420 sec latency 226.347 ms 2024-04-17T14:51:12.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25349 0.26 MB/sec execute 421 sec latency 327.591 ms 2024-04-17T14:51:13.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25411 0.26 MB/sec execute 422 sec latency 153.289 ms 2024-04-17T14:51:14.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25428 0.25 MB/sec execute 423 sec latency 430.788 ms 2024-04-17T14:51:15.977 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25442 0.25 MB/sec execute 424 sec latency 438.275 ms 2024-04-17T14:51:16.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25448 0.25 MB/sec execute 425 sec latency 352.599 ms 2024-04-17T14:51:17.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25468 0.25 MB/sec execute 426 sec latency 141.833 ms 2024-04-17T14:51:18.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25494 0.25 MB/sec execute 427 sec latency 160.781 ms 2024-04-17T14:51:19.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25524 0.25 MB/sec execute 428 sec latency 851.072 ms 2024-04-17T14:51:20.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25585 0.25 MB/sec execute 429 sec latency 150.572 ms 2024-04-17T14:51:21.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25597 0.25 MB/sec execute 430 sec latency 481.450 ms 2024-04-17T14:51:22.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25655 0.25 MB/sec execute 431 sec latency 295.580 ms 2024-04-17T14:51:23.978 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25675 0.25 MB/sec execute 432 sec latency 489.591 ms 2024-04-17T14:51:24.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25742 0.25 MB/sec execute 433 sec latency 317.997 ms 2024-04-17T14:51:25.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25787 0.25 MB/sec execute 434 sec latency 272.239 ms 2024-04-17T14:51:26.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25798 0.25 MB/sec execute 435 sec latency 475.188 ms 2024-04-17T14:51:27.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25853 0.25 MB/sec execute 436 sec latency 264.945 ms 2024-04-17T14:51:28.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25912 0.25 MB/sec execute 437 sec latency 356.928 ms 2024-04-17T14:51:29.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25947 0.25 MB/sec execute 438 sec latency 267.362 ms 2024-04-17T14:51:30.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26016 0.25 MB/sec execute 439 sec latency 282.157 ms 2024-04-17T14:51:31.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26053 0.25 MB/sec execute 440 sec latency 263.361 ms 2024-04-17T14:51:32.979 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26061 0.25 MB/sec execute 441 sec latency 514.569 ms 2024-04-17T14:51:33.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:51:33.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:51:33.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26112 0.25 MB/sec execute 442 sec latency 217.525 ms 2024-04-17T14:51:34.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26274 0.25 MB/sec execute 443 sec latency 213.972 ms 2024-04-17T14:51:35.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26309 0.25 MB/sec execute 444 sec latency 267.324 ms 2024-04-17T14:51:36.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26327 0.25 MB/sec execute 445 sec latency 454.398 ms 2024-04-17T14:51:37.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26394 0.25 MB/sec execute 446 sec latency 248.667 ms 2024-04-17T14:51:38.980 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26466 0.25 MB/sec execute 447 sec latency 217.462 ms 2024-04-17T14:51:39.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26534 0.25 MB/sec execute 448 sec latency 246.663 ms 2024-04-17T14:51:40.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26570 0.25 MB/sec execute 449 sec latency 387.317 ms 2024-04-17T14:51:41.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26683 0.25 MB/sec execute 450 sec latency 295.053 ms 2024-04-17T14:51:42.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26790 0.25 MB/sec execute 451 sec latency 218.830 ms 2024-04-17T14:51:43.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 26869 0.25 MB/sec execute 452 sec latency 338.609 ms 2024-04-17T14:51:44.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27075 0.25 MB/sec execute 453 sec latency 340.855 ms 2024-04-17T14:51:45.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27198 0.25 MB/sec execute 454 sec latency 251.755 ms 2024-04-17T14:51:46.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27210 0.25 MB/sec execute 455 sec latency 400.012 ms 2024-04-17T14:51:47.981 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27264 0.25 MB/sec execute 456 sec latency 271.826 ms 2024-04-17T14:51:48.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27304 0.25 MB/sec execute 457 sec latency 298.601 ms 2024-04-17T14:51:49.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27312 0.25 MB/sec execute 458 sec latency 710.913 ms 2024-04-17T14:51:50.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27325 0.25 MB/sec execute 459 sec latency 367.513 ms 2024-04-17T14:51:51.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27360 0.25 MB/sec execute 460 sec latency 261.656 ms 2024-04-17T14:51:52.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27433 0.25 MB/sec execute 461 sec latency 237.417 ms 2024-04-17T14:51:53.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27470 0.25 MB/sec execute 462 sec latency 237.336 ms 2024-04-17T14:51:54.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27628 0.26 MB/sec execute 463 sec latency 325.634 ms 2024-04-17T14:51:55.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27651 0.26 MB/sec execute 464 sec latency 208.624 ms 2024-04-17T14:51:56.982 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27668 0.26 MB/sec execute 465 sec latency 636.816 ms 2024-04-17T14:51:57.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27773 0.26 MB/sec execute 466 sec latency 168.962 ms 2024-04-17T14:51:58.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27805 0.26 MB/sec execute 467 sec latency 324.707 ms 2024-04-17T14:51:59.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27855 0.26 MB/sec execute 468 sec latency 211.736 ms 2024-04-17T14:52:00.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27883 0.26 MB/sec execute 469 sec latency 226.103 ms 2024-04-17T14:52:01.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28042 0.26 MB/sec execute 470 sec latency 249.765 ms 2024-04-17T14:52:02.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28075 0.26 MB/sec execute 471 sec latency 244.705 ms 2024-04-17T14:52:03.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:52:03.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:52:03.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28211 0.26 MB/sec execute 472 sec latency 186.249 ms 2024-04-17T14:52:04.983 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28235 0.26 MB/sec execute 473 sec latency 259.991 ms 2024-04-17T14:52:05.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28249 0.26 MB/sec execute 474 sec latency 227.127 ms 2024-04-17T14:52:06.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28374 0.26 MB/sec execute 475 sec latency 452.217 ms 2024-04-17T14:52:07.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28400 0.26 MB/sec execute 476 sec latency 254.650 ms 2024-04-17T14:52:08.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28424 0.26 MB/sec execute 477 sec latency 211.010 ms 2024-04-17T14:52:09.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28449 0.26 MB/sec execute 478 sec latency 178.190 ms 2024-04-17T14:52:10.984 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28489 0.26 MB/sec execute 479 sec latency 367.737 ms 2024-04-17T14:52:11.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28524 0.26 MB/sec execute 480 sec latency 310.034 ms 2024-04-17T14:52:12.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28555 0.26 MB/sec execute 481 sec latency 223.935 ms 2024-04-17T14:52:13.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28567 0.26 MB/sec execute 482 sec latency 500.552 ms 2024-04-17T14:52:14.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28594 0.26 MB/sec execute 483 sec latency 193.872 ms 2024-04-17T14:52:15.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28635 0.26 MB/sec execute 484 sec latency 227.980 ms 2024-04-17T14:52:16.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28644 0.26 MB/sec execute 485 sec latency 416.090 ms 2024-04-17T14:52:17.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28659 0.26 MB/sec execute 486 sec latency 525.229 ms 2024-04-17T14:52:18.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28675 0.26 MB/sec execute 487 sec latency 242.267 ms 2024-04-17T14:52:19.985 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28695 0.26 MB/sec execute 488 sec latency 270.405 ms 2024-04-17T14:52:20.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28711 0.26 MB/sec execute 489 sec latency 192.019 ms 2024-04-17T14:52:21.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28733 0.26 MB/sec execute 490 sec latency 216.844 ms 2024-04-17T14:52:22.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28778 0.26 MB/sec execute 491 sec latency 151.006 ms 2024-04-17T14:52:23.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28791 0.26 MB/sec execute 492 sec latency 193.300 ms 2024-04-17T14:52:24.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28806 0.26 MB/sec execute 493 sec latency 326.085 ms 2024-04-17T14:52:25.986 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28819 0.26 MB/sec execute 494 sec latency 307.356 ms 2024-04-17T14:52:26.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28834 0.26 MB/sec execute 495 sec latency 332.917 ms 2024-04-17T14:52:27.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28850 0.26 MB/sec execute 496 sec latency 481.210 ms 2024-04-17T14:52:28.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28873 0.25 MB/sec execute 497 sec latency 184.135 ms 2024-04-17T14:52:29.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28893 0.25 MB/sec execute 498 sec latency 218.650 ms 2024-04-17T14:52:30.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28950 0.25 MB/sec execute 499 sec latency 140.288 ms 2024-04-17T14:52:31.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28965 0.25 MB/sec execute 500 sec latency 404.577 ms 2024-04-17T14:52:32.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28980 0.25 MB/sec execute 501 sec latency 333.474 ms 2024-04-17T14:52:33.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:52:33.282 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:52:33.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29010 0.25 MB/sec execute 502 sec latency 125.343 ms 2024-04-17T14:52:34.987 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29065 0.25 MB/sec execute 503 sec latency 132.281 ms 2024-04-17T14:52:35.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29078 0.25 MB/sec execute 504 sec latency 798.773 ms 2024-04-17T14:52:36.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29127 0.25 MB/sec execute 505 sec latency 261.175 ms 2024-04-17T14:52:37.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29149 0.25 MB/sec execute 506 sec latency 638.751 ms 2024-04-17T14:52:38.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29206 0.25 MB/sec execute 507 sec latency 339.529 ms 2024-04-17T14:52:39.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29272 0.25 MB/sec execute 508 sec latency 282.891 ms 2024-04-17T14:52:40.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29290 0.25 MB/sec execute 509 sec latency 503.766 ms 2024-04-17T14:52:41.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29329 0.25 MB/sec execute 510 sec latency 380.651 ms 2024-04-17T14:52:42.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29390 0.25 MB/sec execute 511 sec latency 252.146 ms 2024-04-17T14:52:43.988 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29454 0.25 MB/sec execute 512 sec latency 265.579 ms 2024-04-17T14:52:44.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29489 0.25 MB/sec execute 513 sec latency 215.239 ms 2024-04-17T14:52:45.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29552 0.25 MB/sec execute 514 sec latency 190.447 ms 2024-04-17T14:52:46.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29583 0.25 MB/sec execute 515 sec latency 598.782 ms 2024-04-17T14:52:47.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29623 0.25 MB/sec execute 516 sec latency 216.998 ms 2024-04-17T14:52:48.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29673 0.25 MB/sec execute 517 sec latency 258.032 ms 2024-04-17T14:52:49.989 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29827 0.25 MB/sec execute 518 sec latency 153.935 ms 2024-04-17T14:52:50.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29869 0.25 MB/sec execute 519 sec latency 421.644 ms 2024-04-17T14:52:51.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29913 0.25 MB/sec execute 520 sec latency 251.203 ms 2024-04-17T14:52:52.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29947 0.25 MB/sec execute 521 sec latency 348.972 ms 2024-04-17T14:52:53.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30057 0.25 MB/sec execute 522 sec latency 193.031 ms 2024-04-17T14:52:54.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30109 0.25 MB/sec execute 523 sec latency 250.717 ms 2024-04-17T14:52:55.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30122 0.25 MB/sec execute 524 sec latency 438.421 ms 2024-04-17T14:52:56.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30181 0.25 MB/sec execute 525 sec latency 174.931 ms 2024-04-17T14:52:57.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30243 0.25 MB/sec execute 526 sec latency 325.794 ms 2024-04-17T14:52:58.990 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30373 0.25 MB/sec execute 527 sec latency 240.677 ms 2024-04-17T14:52:59.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30558 0.25 MB/sec execute 528 sec latency 220.525 ms 2024-04-17T14:53:00.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30714 0.25 MB/sec execute 529 sec latency 169.037 ms 2024-04-17T14:53:01.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30753 0.25 MB/sec execute 530 sec latency 320.796 ms 2024-04-17T14:53:02.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30807 0.25 MB/sec execute 531 sec latency 176.449 ms 2024-04-17T14:53:03.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:53:03.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:53:03.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30815 0.25 MB/sec execute 532 sec latency 623.570 ms 2024-04-17T14:53:04.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30847 0.25 MB/sec execute 533 sec latency 164.493 ms 2024-04-17T14:53:05.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30871 0.25 MB/sec execute 534 sec latency 225.905 ms 2024-04-17T14:53:06.991 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30886 0.25 MB/sec execute 535 sec latency 446.283 ms 2024-04-17T14:53:07.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30918 0.25 MB/sec execute 536 sec latency 277.612 ms 2024-04-17T14:53:08.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 30993 0.25 MB/sec execute 537 sec latency 250.605 ms 2024-04-17T14:53:09.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31019 0.25 MB/sec execute 538 sec latency 547.108 ms 2024-04-17T14:53:10.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31176 0.26 MB/sec execute 539 sec latency 206.537 ms 2024-04-17T14:53:11.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31240 0.26 MB/sec execute 540 sec latency 178.373 ms 2024-04-17T14:53:12.993 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31312 0.26 MB/sec execute 541 sec latency 258.560 ms 2024-04-17T14:53:13.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31345 0.26 MB/sec execute 542 sec latency 156.261 ms 2024-04-17T14:53:14.992 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31408 0.26 MB/sec execute 543 sec latency 225.608 ms 2024-04-17T14:53:15.993 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31430 0.26 MB/sec execute 544 sec latency 336.961 ms 2024-04-17T14:53:16.993 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31591 0.26 MB/sec execute 545 sec latency 315.784 ms 2024-04-17T14:53:17.993 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31612 0.26 MB/sec execute 546 sec latency 456.381 ms 2024-04-17T14:53:18.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31711 0.26 MB/sec execute 547 sec latency 314.920 ms 2024-04-17T14:53:19.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31779 0.26 MB/sec execute 548 sec latency 160.188 ms 2024-04-17T14:53:20.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31907 0.26 MB/sec execute 549 sec latency 182.240 ms 2024-04-17T14:53:21.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31937 0.26 MB/sec execute 550 sec latency 357.299 ms 2024-04-17T14:53:22.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31953 0.26 MB/sec execute 551 sec latency 375.838 ms 2024-04-17T14:53:23.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31970 0.26 MB/sec execute 552 sec latency 317.090 ms 2024-04-17T14:53:24.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32025 0.26 MB/sec execute 553 sec latency 202.304 ms 2024-04-17T14:53:25.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32041 0.26 MB/sec execute 554 sec latency 357.001 ms 2024-04-17T14:53:26.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32058 0.26 MB/sec execute 555 sec latency 292.137 ms 2024-04-17T14:53:27.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32060 0.26 MB/sec execute 556 sec latency 793.267 ms 2024-04-17T14:53:28.994 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32095 0.26 MB/sec execute 557 sec latency 927.694 ms 2024-04-17T14:53:29.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32121 0.26 MB/sec execute 558 sec latency 316.589 ms 2024-04-17T14:53:30.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32174 0.26 MB/sec execute 559 sec latency 173.065 ms 2024-04-17T14:53:31.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32190 0.26 MB/sec execute 560 sec latency 235.964 ms 2024-04-17T14:53:32.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32206 0.26 MB/sec execute 561 sec latency 236.104 ms 2024-04-17T14:53:33.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:53:33.542 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:53:33.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32226 0.26 MB/sec execute 562 sec latency 184.843 ms 2024-04-17T14:53:34.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32242 0.26 MB/sec execute 563 sec latency 402.461 ms 2024-04-17T14:53:35.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32258 0.26 MB/sec execute 564 sec latency 204.989 ms 2024-04-17T14:53:36.995 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32284 0.26 MB/sec execute 565 sec latency 191.711 ms 2024-04-17T14:53:37.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32307 0.26 MB/sec execute 566 sec latency 280.536 ms 2024-04-17T14:53:38.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32338 0.26 MB/sec execute 567 sec latency 145.360 ms 2024-04-17T14:53:39.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32350 0.26 MB/sec execute 568 sec latency 397.250 ms 2024-04-17T14:53:40.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32364 0.26 MB/sec execute 569 sec latency 354.090 ms 2024-04-17T14:53:41.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32385 0.26 MB/sec execute 570 sec latency 174.266 ms 2024-04-17T14:53:42.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32405 0.26 MB/sec execute 571 sec latency 157.521 ms 2024-04-17T14:53:43.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32424 0.25 MB/sec execute 572 sec latency 195.424 ms 2024-04-17T14:53:44.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32440 0.25 MB/sec execute 573 sec latency 362.553 ms 2024-04-17T14:53:45.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32491 0.25 MB/sec execute 574 sec latency 257.728 ms 2024-04-17T14:53:46.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32518 0.25 MB/sec execute 575 sec latency 159.939 ms 2024-04-17T14:53:47.996 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32523 0.25 MB/sec execute 576 sec latency 443.976 ms 2024-04-17T14:53:48.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32540 0.25 MB/sec execute 577 sec latency 536.952 ms 2024-04-17T14:53:49.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32560 0.25 MB/sec execute 578 sec latency 128.188 ms 2024-04-17T14:53:50.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32613 0.25 MB/sec execute 579 sec latency 283.821 ms 2024-04-17T14:53:51.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32631 0.25 MB/sec execute 580 sec latency 799.307 ms 2024-04-17T14:53:52.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32681 0.25 MB/sec execute 581 sec latency 422.674 ms 2024-04-17T14:53:53.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32716 0.25 MB/sec execute 582 sec latency 260.714 ms 2024-04-17T14:53:54.997 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32754 0.25 MB/sec execute 583 sec latency 288.277 ms 2024-04-17T14:53:55.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32791 0.25 MB/sec execute 584 sec latency 307.746 ms 2024-04-17T14:53:56.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32839 0.25 MB/sec execute 585 sec latency 396.740 ms 2024-04-17T14:53:57.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32873 0.25 MB/sec execute 586 sec latency 443.252 ms 2024-04-17T14:53:58.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32908 0.25 MB/sec execute 587 sec latency 348.336 ms 2024-04-17T14:53:59.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32943 0.25 MB/sec execute 588 sec latency 325.823 ms 2024-04-17T14:54:01.001 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33005 0.25 MB/sec execute 589 sec latency 408.762 ms 2024-04-17T14:54:01.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33057 0.25 MB/sec execute 590 sec latency 249.829 ms 2024-04-17T14:54:02.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33100 0.25 MB/sec execute 591 sec latency 512.333 ms 2024-04-17T14:54:03.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:54:03.623 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:54:03.998 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33144 0.25 MB/sec execute 592 sec latency 259.836 ms 2024-04-17T14:54:04.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33186 0.25 MB/sec execute 593 sec latency 234.184 ms 2024-04-17T14:54:05.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33223 0.25 MB/sec execute 594 sec latency 318.060 ms 2024-04-17T14:54:06.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33374 0.25 MB/sec execute 595 sec latency 160.630 ms 2024-04-17T14:54:07.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33399 0.25 MB/sec execute 596 sec latency 660.484 ms 2024-04-17T14:54:08.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33436 0.25 MB/sec execute 597 sec latency 268.446 ms 2024-04-17T14:54:09.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33494 0.25 MB/sec execute 598 sec latency 161.372 ms 2024-04-17T14:54:10.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 33573 0.25 MB/sec execute 599 sec latency 206.778 ms 2024-04-17T14:54:11.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 600 sec 2024-04-17T14:54:12.999 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 601 sec 2024-04-17T14:54:14.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 602 sec 2024-04-17T14:54:15.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 603 sec 2024-04-17T14:54:16.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 604 sec 2024-04-17T14:54:17.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 605 sec 2024-04-17T14:54:18.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 606 sec 2024-04-17T14:54:19.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 607 sec 2024-04-17T14:54:20.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 608 sec 2024-04-17T14:54:21.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 609 sec 2024-04-17T14:54:22.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 610 sec 2024-04-17T14:54:23.000 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 611 sec 2024-04-17T14:54:23.476 INFO:tasks.workunit.client.0.smithi016.stdout: 0 cleanup 612 sec 2024-04-17T14:54:23.476 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T14:54:23.476 INFO:tasks.workunit.client.0.smithi016.stdout: Operation Count AvgLat MaxLat 2024-04-17T14:54:23.476 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: NTCreateX 4768 50.135 927.685 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Close 3470 0.007 0.139 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Rename 204 232.531 1233.026 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Unlink 978 107.963 618.332 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Qpathinfo 4281 34.615 1399.964 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Qfileinfo 747 0.002 0.035 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Qfsinfo 808 11.935 489.698 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Sfileinfo 390 29.254 902.939 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Find 1672 4.686 536.940 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: WriteX 2354 2.403 400.001 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: ReadX 7584 0.337 334.437 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: LockX 16 110.451 502.982 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: UnlockX 16 74.608 164.284 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: Flush 338 58.418 443.209 2024-04-17T14:54:23.477 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T14:54:23.478 INFO:tasks.workunit.client.0.smithi016.stdout:Throughput 0.25217 MB/sec 1 clients 1 procs max_latency=1399.977 ms 2024-04-17T14:54:23.478 INFO:tasks.workunit.client.0.smithi016.stderr:+ dbench 10 2024-04-17T14:54:23.478 INFO:tasks.workunit.client.0.smithi016.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-17T14:54:23.478 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T14:54:23.478 INFO:tasks.workunit.client.0.smithi016.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-17T14:54:23.480 INFO:tasks.workunit.client.0.smithi016.stdout:9 of 10 processes prepared for launch 0 sec 2024-04-17T14:54:23.580 INFO:tasks.workunit.client.0.smithi016.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-17T14:54:23.580 INFO:tasks.workunit.client.0.smithi016.stdout:releasing clients 2024-04-17T14:54:24.581 INFO:tasks.workunit.client.0.smithi016.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.655 ms 2024-04-17T14:54:25.581 INFO:tasks.workunit.client.0.smithi016.stdout: 2 12 1.57 MB/sec warmup 2 sec latency 1834.075 ms 2024-04-17T14:54:26.581 INFO:tasks.workunit.client.0.smithi016.stdout: 2 17 1.75 MB/sec warmup 3 sec latency 2834.141 ms 2024-04-17T14:54:27.581 INFO:tasks.workunit.client.0.smithi016.stdout: 6 27 2.36 MB/sec warmup 4 sec latency 3823.112 ms 2024-04-17T14:54:28.581 INFO:tasks.workunit.client.0.smithi016.stdout: 6 31 2.31 MB/sec warmup 5 sec latency 4823.185 ms 2024-04-17T14:54:29.581 INFO:tasks.workunit.client.0.smithi016.stdout: 7 39 2.62 MB/sec warmup 6 sec latency 5823.257 ms 2024-04-17T14:54:30.581 INFO:tasks.workunit.client.0.smithi016.stdout: 7 41 2.40 MB/sec warmup 7 sec latency 6823.335 ms 2024-04-17T14:54:31.582 INFO:tasks.workunit.client.0.smithi016.stdout: 8 55 3.01 MB/sec warmup 8 sec latency 7823.411 ms 2024-04-17T14:54:32.581 INFO:tasks.workunit.client.0.smithi016.stdout: 8 56 2.68 MB/sec warmup 9 sec latency 2256.824 ms 2024-04-17T14:54:33.581 INFO:tasks.workunit.client.0.smithi016.stdout: 8 61 2.65 MB/sec warmup 10 sec latency 2520.189 ms 2024-04-17T14:54:33.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:54:33.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:54:34.581 INFO:tasks.workunit.client.0.smithi016.stdout: 8 71 2.88 MB/sec warmup 11 sec latency 3072.488 ms 2024-04-17T14:54:35.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79 2.93 MB/sec warmup 12 sec latency 2342.289 ms 2024-04-17T14:54:36.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 97 3.41 MB/sec warmup 13 sec latency 2268.781 ms 2024-04-17T14:54:37.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 99 3.18 MB/sec warmup 14 sec latency 1911.186 ms 2024-04-17T14:54:38.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 110 3.32 MB/sec warmup 15 sec latency 2177.187 ms 2024-04-17T14:54:39.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 112 3.14 MB/sec warmup 16 sec latency 2011.292 ms 2024-04-17T14:54:40.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 118 3.13 MB/sec warmup 17 sec latency 2576.700 ms 2024-04-17T14:54:41.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 126 3.10 MB/sec warmup 18 sec latency 3307.890 ms 2024-04-17T14:54:42.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 128 2.98 MB/sec warmup 19 sec latency 2301.924 ms 2024-04-17T14:54:43.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 133 2.92 MB/sec warmup 20 sec latency 2406.655 ms 2024-04-17T14:54:44.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 137 2.86 MB/sec warmup 21 sec latency 2875.607 ms 2024-04-17T14:54:45.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 140 2.77 MB/sec warmup 22 sec latency 3271.195 ms 2024-04-17T14:54:46.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 144 2.70 MB/sec warmup 23 sec latency 3551.104 ms 2024-04-17T14:54:47.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 146 2.61 MB/sec warmup 24 sec latency 3000.970 ms 2024-04-17T14:54:48.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148 2.53 MB/sec warmup 25 sec latency 2821.992 ms 2024-04-17T14:54:49.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 152 2.48 MB/sec warmup 26 sec latency 3111.417 ms 2024-04-17T14:54:50.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 153 2.40 MB/sec warmup 27 sec latency 3426.123 ms 2024-04-17T14:54:51.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 156 2.35 MB/sec warmup 28 sec latency 3566.393 ms 2024-04-17T14:54:52.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 2.28 MB/sec warmup 29 sec latency 3526.693 ms 2024-04-17T14:54:53.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 2.21 MB/sec warmup 30 sec latency 4526.830 ms 2024-04-17T14:54:54.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 2.14 MB/sec warmup 31 sec latency 5526.968 ms 2024-04-17T14:54:55.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 2.07 MB/sec warmup 32 sec latency 6527.083 ms 2024-04-17T14:54:56.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 2.01 MB/sec warmup 33 sec latency 7527.230 ms 2024-04-17T14:54:57.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 1.95 MB/sec warmup 34 sec latency 8527.364 ms 2024-04-17T14:54:58.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158 1.90 MB/sec warmup 35 sec latency 9527.437 ms 2024-04-17T14:54:59.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 160 1.86 MB/sec warmup 36 sec latency 10199.557 ms 2024-04-17T14:55:00.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165 1.85 MB/sec warmup 37 sec latency 9960.509 ms 2024-04-17T14:55:01.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 167 1.82 MB/sec warmup 38 sec latency 4853.739 ms 2024-04-17T14:55:02.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 169 1.78 MB/sec warmup 39 sec latency 3518.076 ms 2024-04-17T14:55:03.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 171 1.76 MB/sec warmup 40 sec latency 3900.215 ms 2024-04-17T14:55:03.723 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:55:03.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:55:04.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 174 1.74 MB/sec warmup 41 sec latency 4240.348 ms 2024-04-17T14:55:04.866 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:16:29.233 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:04.870 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:16:29.238 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:04.984 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:16:29.352 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:04.996 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:16:29.306 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.019 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:16:29.328 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.021 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:16:29.341 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.025 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:16:29.345 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.200 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:16:29.510 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.218 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:16:29.538 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:55:05.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176 1.71 MB/sec warmup 42 sec latency 5240.470 ms 2024-04-17T14:55:06.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 178 1.68 MB/sec warmup 43 sec latency 6052.556 ms 2024-04-17T14:55:07.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 182 1.68 MB/sec warmup 44 sec latency 4057.872 ms 2024-04-17T14:55:08.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185 1.66 MB/sec warmup 45 sec latency 3085.102 ms 2024-04-17T14:55:09.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 187 1.63 MB/sec warmup 46 sec latency 2933.617 ms 2024-04-17T14:55:10.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 190 1.62 MB/sec warmup 47 sec latency 3147.390 ms 2024-04-17T14:55:11.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 192 1.60 MB/sec warmup 48 sec latency 3599.688 ms 2024-04-17T14:55:12.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 195 1.58 MB/sec warmup 49 sec latency 3727.549 ms 2024-04-17T14:55:13.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 198 1.57 MB/sec warmup 50 sec latency 3267.543 ms 2024-04-17T14:55:14.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 201 1.56 MB/sec warmup 51 sec latency 3355.341 ms 2024-04-17T14:55:15.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204 1.55 MB/sec warmup 52 sec latency 3430.737 ms 2024-04-17T14:55:16.586 INFO:tasks.workunit.client.0.smithi016.stdout: 10 207 1.54 MB/sec warmup 53 sec latency 2652.752 ms 2024-04-17T14:55:17.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.52 MB/sec warmup 54 sec latency 2820.156 ms 2024-04-17T14:55:18.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.49 MB/sec warmup 55 sec latency 3714.803 ms 2024-04-17T14:55:19.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.47 MB/sec warmup 56 sec latency 4714.929 ms 2024-04-17T14:55:20.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.44 MB/sec warmup 57 sec latency 5715.045 ms 2024-04-17T14:55:21.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.42 MB/sec warmup 58 sec latency 6715.189 ms 2024-04-17T14:55:22.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.39 MB/sec warmup 59 sec latency 7715.350 ms 2024-04-17T14:55:23.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209 1.37 MB/sec warmup 60 sec latency 8715.497 ms 2024-04-17T14:55:24.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 211 1.35 MB/sec warmup 61 sec latency 9297.997 ms 2024-04-17T14:55:25.587 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214 1.35 MB/sec warmup 62 sec latency 9327.463 ms 2024-04-17T14:55:26.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 217 1.34 MB/sec warmup 63 sec latency 9647.534 ms 2024-04-17T14:55:27.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 218 1.32 MB/sec warmup 64 sec latency 9567.082 ms 2024-04-17T14:55:28.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 221 1.32 MB/sec warmup 65 sec latency 3694.091 ms 2024-04-17T14:55:29.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 223 1.31 MB/sec warmup 66 sec latency 3943.442 ms 2024-04-17T14:55:30.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225 1.30 MB/sec warmup 67 sec latency 4073.797 ms 2024-04-17T14:55:31.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 226 1.28 MB/sec warmup 68 sec latency 3917.717 ms 2024-04-17T14:55:32.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 230 1.28 MB/sec warmup 69 sec latency 3622.710 ms 2024-04-17T14:55:33.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 233 1.28 MB/sec warmup 70 sec latency 3538.039 ms 2024-04-17T14:55:33.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:55:33.912 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:55:34.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 234 1.27 MB/sec warmup 71 sec latency 3057.465 ms 2024-04-17T14:55:35.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 237 1.26 MB/sec warmup 72 sec latency 3453.772 ms 2024-04-17T14:55:36.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 239 1.26 MB/sec warmup 73 sec latency 3689.457 ms 2024-04-17T14:55:37.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242 1.25 MB/sec warmup 74 sec latency 3415.256 ms 2024-04-17T14:55:38.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 244 1.24 MB/sec warmup 75 sec latency 3275.018 ms 2024-04-17T14:55:39.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 248 1.24 MB/sec warmup 76 sec latency 3277.463 ms 2024-04-17T14:55:40.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 251 1.24 MB/sec warmup 77 sec latency 2720.019 ms 2024-04-17T14:55:41.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 253 1.23 MB/sec warmup 78 sec latency 2997.387 ms 2024-04-17T14:55:42.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 255 1.23 MB/sec warmup 79 sec latency 3401.396 ms 2024-04-17T14:55:43.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 260 1.23 MB/sec warmup 80 sec latency 3430.404 ms 2024-04-17T14:55:44.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 262 1.22 MB/sec warmup 81 sec latency 3154.260 ms 2024-04-17T14:55:45.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 264 1.22 MB/sec warmup 82 sec latency 3138.696 ms 2024-04-17T14:55:46.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 270 1.22 MB/sec warmup 83 sec latency 3460.139 ms 2024-04-17T14:55:47.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 272 1.22 MB/sec warmup 84 sec latency 2154.448 ms 2024-04-17T14:55:48.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 279 1.23 MB/sec warmup 85 sec latency 2400.179 ms 2024-04-17T14:55:49.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 281 1.22 MB/sec warmup 86 sec latency 2699.879 ms 2024-04-17T14:55:50.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 284 1.22 MB/sec warmup 87 sec latency 3087.889 ms 2024-04-17T14:55:51.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 288 1.22 MB/sec warmup 88 sec latency 2691.667 ms 2024-04-17T14:55:52.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 289 1.21 MB/sec warmup 89 sec latency 2611.962 ms 2024-04-17T14:55:53.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 290 1.20 MB/sec warmup 90 sec latency 3221.220 ms 2024-04-17T14:55:54.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 292 1.19 MB/sec warmup 91 sec latency 3813.787 ms 2024-04-17T14:55:55.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 292 1.18 MB/sec warmup 92 sec latency 4813.858 ms 2024-04-17T14:55:56.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 292 1.16 MB/sec warmup 93 sec latency 5813.968 ms 2024-04-17T14:55:57.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 292 1.15 MB/sec warmup 94 sec latency 6814.107 ms 2024-04-17T14:55:58.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 292 1.14 MB/sec warmup 95 sec latency 7814.176 ms 2024-04-17T14:55:59.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 295 1.14 MB/sec warmup 96 sec latency 8214.052 ms 2024-04-17T14:56:00.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 299 1.14 MB/sec warmup 97 sec latency 7917.061 ms 2024-04-17T14:56:01.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 300 1.13 MB/sec warmup 98 sec latency 8205.241 ms 2024-04-17T14:56:02.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 301 1.12 MB/sec warmup 99 sec latency 7796.663 ms 2024-04-17T14:56:03.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 302 1.11 MB/sec warmup 100 sec latency 4638.414 ms 2024-04-17T14:56:03.963 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:56:03.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:56:04.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 304 1.11 MB/sec warmup 101 sec latency 5584.772 ms 2024-04-17T14:56:05.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 306 1.10 MB/sec warmup 102 sec latency 6210.559 ms 2024-04-17T14:56:06.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 311 1.11 MB/sec warmup 103 sec latency 4670.795 ms 2024-04-17T14:56:07.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 313 1.10 MB/sec warmup 104 sec latency 2803.069 ms 2024-04-17T14:56:08.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 315 1.10 MB/sec warmup 105 sec latency 2586.862 ms 2024-04-17T14:56:09.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 318 1.10 MB/sec warmup 106 sec latency 3381.801 ms 2024-04-17T14:56:10.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 322 1.10 MB/sec warmup 107 sec latency 3475.134 ms 2024-04-17T14:56:11.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 324 1.09 MB/sec warmup 108 sec latency 3028.345 ms 2024-04-17T14:56:12.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 328 1.09 MB/sec warmup 109 sec latency 3652.846 ms 2024-04-17T14:56:13.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 332 1.10 MB/sec warmup 110 sec latency 3314.507 ms 2024-04-17T14:56:14.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 334 1.09 MB/sec warmup 111 sec latency 2191.885 ms 2024-04-17T14:56:15.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 339 1.09 MB/sec warmup 112 sec latency 2323.055 ms 2024-04-17T14:56:16.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 340 1.09 MB/sec warmup 113 sec latency 3310.479 ms 2024-04-17T14:56:17.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 341 1.08 MB/sec warmup 114 sec latency 4079.755 ms 2024-04-17T14:56:18.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 347 1.09 MB/sec warmup 115 sec latency 3828.242 ms 2024-04-17T14:56:19.593 INFO:tasks.workunit.client.0.smithi016.stdout: 10 349 1.08 MB/sec warmup 116 sec latency 3003.397 ms 2024-04-17T14:56:20.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 349 1.07 MB/sec warmup 117 sec latency 3320.572 ms 2024-04-17T14:56:21.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 353 1.08 MB/sec warmup 118 sec latency 3531.131 ms 2024-04-17T14:56:22.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 356 1.07 MB/sec warmup 119 sec latency 3756.695 ms 2024-04-17T14:56:24.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 362 1.30 MB/sec execute 1 sec latency 3774.697 ms 2024-04-17T14:56:25.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 365 1.04 MB/sec execute 2 sec latency 3372.166 ms 2024-04-17T14:56:26.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 365 0.78 MB/sec execute 3 sec latency 3611.948 ms 2024-04-17T14:56:27.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 368 0.78 MB/sec execute 4 sec latency 3496.561 ms 2024-04-17T14:56:28.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 372 0.88 MB/sec execute 5 sec latency 4028.388 ms 2024-04-17T14:56:29.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 373 0.82 MB/sec execute 6 sec latency 3548.969 ms 2024-04-17T14:56:30.003 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:17:54.370 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.008 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:17:54.375 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.045 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:17:54.412 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.136 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:17:54.456 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.138 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:17:54.459 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.139 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:17:54.449 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.141 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:17:54.451 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.204 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:17:54.524 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.210 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:17:54.520 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:56:30.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 375 0.78 MB/sec execute 7 sec latency 3691.620 ms 2024-04-17T14:56:31.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 380 0.88 MB/sec execute 8 sec latency 3093.346 ms 2024-04-17T14:56:32.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 383 0.90 MB/sec execute 9 sec latency 2856.787 ms 2024-04-17T14:56:33.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 386 0.91 MB/sec execute 10 sec latency 2878.654 ms 2024-04-17T14:56:34.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:56:34.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:56:34.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 391 0.97 MB/sec execute 11 sec latency 2933.845 ms 2024-04-17T14:56:35.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 393 0.93 MB/sec execute 12 sec latency 2142.104 ms 2024-04-17T14:56:36.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 394 0.90 MB/sec execute 13 sec latency 2693.168 ms 2024-04-17T14:56:37.595 INFO:tasks.workunit.client.0.smithi016.stdout: 10 398 0.93 MB/sec execute 14 sec latency 3479.413 ms 2024-04-17T14:56:38.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 401 0.92 MB/sec execute 15 sec latency 3501.184 ms 2024-04-17T14:56:39.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 402 0.89 MB/sec execute 16 sec latency 3392.494 ms 2024-04-17T14:56:40.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 405 0.90 MB/sec execute 17 sec latency 3287.821 ms 2024-04-17T14:56:41.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 407 0.88 MB/sec execute 18 sec latency 3583.467 ms 2024-04-17T14:56:42.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 410 0.89 MB/sec execute 19 sec latency 3548.424 ms 2024-04-17T14:56:43.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 415 0.92 MB/sec execute 20 sec latency 3172.464 ms 2024-04-17T14:56:44.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 421 0.98 MB/sec execute 21 sec latency 2099.436 ms 2024-04-17T14:56:45.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 422 0.95 MB/sec execute 22 sec latency 2089.083 ms 2024-04-17T14:56:46.596 INFO:tasks.workunit.client.0.smithi016.stdout: 10 422 0.90 MB/sec execute 23 sec latency 3089.156 ms 2024-04-17T14:56:47.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 422 0.87 MB/sec execute 24 sec latency 4089.391 ms 2024-04-17T14:56:48.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 425 0.86 MB/sec execute 25 sec latency 4677.141 ms 2024-04-17T14:56:49.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 427 0.86 MB/sec execute 26 sec latency 5134.309 ms 2024-04-17T14:56:50.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 430 0.87 MB/sec execute 27 sec latency 5730.160 ms 2024-04-17T14:56:51.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 430 0.84 MB/sec execute 28 sec latency 3707.975 ms 2024-04-17T14:56:52.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 430 0.81 MB/sec execute 29 sec latency 4708.119 ms 2024-04-17T14:56:53.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 434 0.82 MB/sec execute 30 sec latency 5072.201 ms 2024-04-17T14:56:54.597 INFO:tasks.workunit.client.0.smithi016.stdout: 10 437 0.83 MB/sec execute 31 sec latency 4736.343 ms 2024-04-17T14:56:55.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 438 0.81 MB/sec execute 32 sec latency 4761.014 ms 2024-04-17T14:56:56.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 438 0.79 MB/sec execute 33 sec latency 3636.034 ms 2024-04-17T14:56:57.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 438 0.76 MB/sec execute 34 sec latency 4636.149 ms 2024-04-17T14:56:58.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 442 0.78 MB/sec execute 35 sec latency 5129.722 ms 2024-04-17T14:56:59.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 445 0.79 MB/sec execute 36 sec latency 5180.559 ms 2024-04-17T14:57:00.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 446 0.77 MB/sec execute 37 sec latency 4953.974 ms 2024-04-17T14:57:01.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 446 0.75 MB/sec execute 38 sec latency 3948.675 ms 2024-04-17T14:57:02.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 447 0.74 MB/sec execute 39 sec latency 4690.398 ms 2024-04-17T14:57:03.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 451 0.75 MB/sec execute 40 sec latency 4921.056 ms 2024-04-17T14:57:04.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:57:04.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:57:04.598 INFO:tasks.workunit.client.0.smithi016.stdout: 10 453 0.75 MB/sec execute 41 sec latency 4669.186 ms 2024-04-17T14:57:05.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 454 0.74 MB/sec execute 42 sec latency 5669.304 ms 2024-04-17T14:57:06.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 455 0.73 MB/sec execute 43 sec latency 6669.471 ms 2024-04-17T14:57:07.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 455 0.72 MB/sec execute 44 sec latency 7669.611 ms 2024-04-17T14:57:08.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 459 0.73 MB/sec execute 45 sec latency 8067.876 ms 2024-04-17T14:57:09.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 463 0.73 MB/sec execute 46 sec latency 5032.129 ms 2024-04-17T14:57:10.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 465 0.74 MB/sec execute 47 sec latency 4519.546 ms 2024-04-17T14:57:11.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 465 0.72 MB/sec execute 48 sec latency 3861.792 ms 2024-04-17T14:57:12.599 INFO:tasks.workunit.client.0.smithi016.stdout: 10 465 0.71 MB/sec execute 49 sec latency 4861.893 ms 2024-04-17T14:57:13.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 469 0.72 MB/sec execute 50 sec latency 5378.838 ms 2024-04-17T14:57:14.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 473 0.74 MB/sec execute 51 sec latency 4843.489 ms 2024-04-17T14:57:15.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 474 0.73 MB/sec execute 52 sec latency 4723.820 ms 2024-04-17T14:57:16.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 477 0.73 MB/sec execute 53 sec latency 3194.388 ms 2024-04-17T14:57:17.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 478 0.73 MB/sec execute 54 sec latency 3982.882 ms 2024-04-17T14:57:18.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 486 0.76 MB/sec execute 55 sec latency 4141.239 ms 2024-04-17T14:57:19.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 488 0.75 MB/sec execute 56 sec latency 3897.981 ms 2024-04-17T14:57:20.600 INFO:tasks.workunit.client.0.smithi016.stdout: 10 493 0.76 MB/sec execute 57 sec latency 4483.701 ms 2024-04-17T14:57:21.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 494 0.75 MB/sec execute 58 sec latency 4268.721 ms 2024-04-17T14:57:22.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 495 0.74 MB/sec execute 59 sec latency 5203.573 ms 2024-04-17T14:57:23.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 498 0.74 MB/sec execute 60 sec latency 5025.473 ms 2024-04-17T14:57:24.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 501 0.75 MB/sec execute 61 sec latency 4187.831 ms 2024-04-17T14:57:25.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 503 0.74 MB/sec execute 62 sec latency 4017.146 ms 2024-04-17T14:57:26.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 506 0.74 MB/sec execute 63 sec latency 3499.906 ms 2024-04-17T14:57:27.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 506 0.73 MB/sec execute 64 sec latency 4275.609 ms 2024-04-17T14:57:28.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 507 0.72 MB/sec execute 65 sec latency 5110.369 ms 2024-04-17T14:57:29.601 INFO:tasks.workunit.client.0.smithi016.stdout: 10 509 0.72 MB/sec execute 66 sec latency 5043.421 ms 2024-04-17T14:57:30.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 510 0.71 MB/sec execute 67 sec latency 6043.586 ms 2024-04-17T14:57:31.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 514 0.72 MB/sec execute 68 sec latency 6816.145 ms 2024-04-17T14:57:32.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 514 0.71 MB/sec execute 69 sec latency 3392.176 ms 2024-04-17T14:57:33.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 515 0.71 MB/sec execute 70 sec latency 4284.250 ms 2024-04-17T14:57:34.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:57:34.157 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:57:34.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 518 0.70 MB/sec execute 71 sec latency 4027.806 ms 2024-04-17T14:57:35.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 523 0.71 MB/sec execute 72 sec latency 4239.012 ms 2024-04-17T14:57:36.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 525 0.70 MB/sec execute 73 sec latency 4341.281 ms 2024-04-17T14:57:37.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 526 0.69 MB/sec execute 74 sec latency 3227.819 ms 2024-04-17T14:57:38.602 INFO:tasks.workunit.client.0.smithi016.stdout: 10 526 0.69 MB/sec execute 75 sec latency 4227.918 ms 2024-04-17T14:57:39.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 529 0.69 MB/sec execute 76 sec latency 5145.847 ms 2024-04-17T14:57:40.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 533 0.70 MB/sec execute 77 sec latency 5263.960 ms 2024-04-17T14:57:41.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 534 0.70 MB/sec execute 78 sec latency 6264.036 ms 2024-04-17T14:57:42.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 534 0.69 MB/sec execute 79 sec latency 7264.113 ms 2024-04-17T14:57:43.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 534 0.68 MB/sec execute 80 sec latency 8264.187 ms 2024-04-17T14:57:44.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 550 0.74 MB/sec execute 81 sec latency 8778.482 ms 2024-04-17T14:57:45.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 552 0.75 MB/sec execute 82 sec latency 5265.393 ms 2024-04-17T14:57:46.603 INFO:tasks.workunit.client.0.smithi016.stdout: 10 556 0.74 MB/sec execute 83 sec latency 2953.554 ms 2024-04-17T14:57:47.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 556 0.73 MB/sec execute 84 sec latency 3953.690 ms 2024-04-17T14:57:48.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 569 0.77 MB/sec execute 85 sec latency 4550.948 ms 2024-04-17T14:57:49.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 583 0.81 MB/sec execute 86 sec latency 4837.669 ms 2024-04-17T14:57:50.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 591 0.81 MB/sec execute 87 sec latency 5837.806 ms 2024-04-17T14:57:51.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 597 0.80 MB/sec execute 88 sec latency 6837.949 ms 2024-04-17T14:57:52.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 598 0.79 MB/sec execute 89 sec latency 7264.218 ms 2024-04-17T14:57:53.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 599 0.79 MB/sec execute 90 sec latency 4507.773 ms 2024-04-17T14:57:54.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 610 0.82 MB/sec execute 91 sec latency 4782.127 ms 2024-04-17T14:57:55.604 INFO:tasks.workunit.client.0.smithi016.stdout: 10 613 0.81 MB/sec execute 92 sec latency 4282.823 ms 2024-04-17T14:57:56.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 621 0.80 MB/sec execute 93 sec latency 4412.539 ms 2024-04-17T14:57:57.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 633 0.84 MB/sec execute 94 sec latency 3500.156 ms 2024-04-17T14:57:58.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 634 0.83 MB/sec execute 95 sec latency 2295.558 ms 2024-04-17T14:57:59.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 641 0.84 MB/sec execute 96 sec latency 3295.675 ms 2024-04-17T14:58:00.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 655 0.85 MB/sec execute 97 sec latency 4221.597 ms 2024-04-17T14:58:01.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 655 0.84 MB/sec execute 98 sec latency 2318.318 ms 2024-04-17T14:58:02.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 660 0.84 MB/sec execute 99 sec latency 2967.022 ms 2024-04-17T14:58:03.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 664 0.83 MB/sec execute 100 sec latency 3967.076 ms 2024-04-17T14:58:04.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:58:04.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:58:04.605 INFO:tasks.workunit.client.0.smithi016.stdout: 10 671 0.82 MB/sec execute 101 sec latency 4480.378 ms 2024-04-17T14:58:05.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 678 0.81 MB/sec execute 102 sec latency 3964.892 ms 2024-04-17T14:58:06.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 678 0.81 MB/sec execute 103 sec latency 4964.946 ms 2024-04-17T14:58:07.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 679 0.80 MB/sec execute 104 sec latency 5965.014 ms 2024-04-17T14:58:08.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 685 0.79 MB/sec execute 105 sec latency 6611.881 ms 2024-04-17T14:58:09.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 685 0.79 MB/sec execute 106 sec latency 5487.153 ms 2024-04-17T14:58:10.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 687 0.78 MB/sec execute 107 sec latency 5710.324 ms 2024-04-17T14:58:11.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 688 0.77 MB/sec execute 108 sec latency 4633.099 ms 2024-04-17T14:58:12.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 689 0.76 MB/sec execute 109 sec latency 5633.243 ms 2024-04-17T14:58:13.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 691 0.76 MB/sec execute 110 sec latency 5837.296 ms 2024-04-17T14:58:14.606 INFO:tasks.workunit.client.0.smithi016.stdout: 10 693 0.75 MB/sec execute 111 sec latency 3280.003 ms 2024-04-17T14:58:15.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 694 0.74 MB/sec execute 112 sec latency 3610.212 ms 2024-04-17T14:58:16.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 697 0.74 MB/sec execute 113 sec latency 3697.895 ms 2024-04-17T14:58:17.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 699 0.73 MB/sec execute 114 sec latency 3219.983 ms 2024-04-17T14:58:18.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 706 0.73 MB/sec execute 115 sec latency 4220.132 ms 2024-04-17T14:58:19.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 708 0.72 MB/sec execute 116 sec latency 5138.432 ms 2024-04-17T14:58:20.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 709 0.72 MB/sec execute 117 sec latency 4882.531 ms 2024-04-17T14:58:21.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 710 0.71 MB/sec execute 118 sec latency 5002.333 ms 2024-04-17T14:58:22.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 713 0.71 MB/sec execute 119 sec latency 3837.476 ms 2024-04-17T14:58:23.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 715 0.70 MB/sec execute 120 sec latency 4191.873 ms 2024-04-17T14:58:24.607 INFO:tasks.workunit.client.0.smithi016.stdout: 10 721 0.70 MB/sec execute 121 sec latency 4823.315 ms 2024-04-17T14:58:25.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 726 0.69 MB/sec execute 122 sec latency 2920.652 ms 2024-04-17T14:58:26.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 726 0.69 MB/sec execute 123 sec latency 2789.423 ms 2024-04-17T14:58:27.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 730 0.68 MB/sec execute 124 sec latency 3789.549 ms 2024-04-17T14:58:28.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 736 0.68 MB/sec execute 125 sec latency 4789.673 ms 2024-04-17T14:58:29.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 736 0.67 MB/sec execute 126 sec latency 5789.828 ms 2024-04-17T14:58:30.608 INFO:tasks.workunit.client.0.smithi016.stdout: 10 738 0.67 MB/sec execute 127 sec latency 6056.061 ms 2024-04-17T14:58:31.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 741 0.66 MB/sec execute 128 sec latency 6408.719 ms 2024-04-17T14:58:32.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 744 0.66 MB/sec execute 129 sec latency 7408.852 ms 2024-04-17T14:58:33.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 747 0.65 MB/sec execute 130 sec latency 7857.013 ms 2024-04-17T14:58:34.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:58:34.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:58:34.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 750 0.65 MB/sec execute 131 sec latency 6272.012 ms 2024-04-17T14:58:35.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 753 0.64 MB/sec execute 132 sec latency 6822.276 ms 2024-04-17T14:58:36.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 755 0.64 MB/sec execute 133 sec latency 5633.319 ms 2024-04-17T14:58:37.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 757 0.63 MB/sec execute 134 sec latency 4287.568 ms 2024-04-17T14:58:38.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 760 0.63 MB/sec execute 135 sec latency 4353.979 ms 2024-04-17T14:58:39.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 761 0.63 MB/sec execute 136 sec latency 5344.030 ms 2024-04-17T14:58:40.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 763 0.62 MB/sec execute 137 sec latency 3849.410 ms 2024-04-17T14:58:41.609 INFO:tasks.workunit.client.0.smithi016.stdout: 10 766 0.62 MB/sec execute 138 sec latency 4228.241 ms 2024-04-17T14:58:42.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 771 0.61 MB/sec execute 139 sec latency 4037.364 ms 2024-04-17T14:58:43.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 772 0.61 MB/sec execute 140 sec latency 4044.027 ms 2024-04-17T14:58:44.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 776 0.61 MB/sec execute 141 sec latency 3998.510 ms 2024-04-17T14:58:45.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 780 0.60 MB/sec execute 142 sec latency 3837.791 ms 2024-04-17T14:58:46.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 783 0.60 MB/sec execute 143 sec latency 3993.803 ms 2024-04-17T14:58:47.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 786 0.60 MB/sec execute 144 sec latency 4336.355 ms 2024-04-17T14:58:48.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 788 0.59 MB/sec execute 145 sec latency 3358.113 ms 2024-04-17T14:58:49.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 794 0.59 MB/sec execute 146 sec latency 4358.181 ms 2024-04-17T14:58:50.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 798 0.59 MB/sec execute 147 sec latency 4723.338 ms 2024-04-17T14:58:51.610 INFO:tasks.workunit.client.0.smithi016.stdout: 10 801 0.58 MB/sec execute 148 sec latency 3951.360 ms 2024-04-17T14:58:52.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 802 0.58 MB/sec execute 149 sec latency 4951.506 ms 2024-04-17T14:58:53.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 802 0.57 MB/sec execute 150 sec latency 5951.649 ms 2024-04-17T14:58:54.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 806 0.57 MB/sec execute 151 sec latency 6951.788 ms 2024-04-17T14:58:55.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 809 0.57 MB/sec execute 152 sec latency 7518.812 ms 2024-04-17T14:58:56.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 815 0.56 MB/sec execute 153 sec latency 6092.706 ms 2024-04-17T14:58:57.611 INFO:tasks.workunit.client.0.smithi016.stdout: 10 819 0.56 MB/sec execute 154 sec latency 6437.791 ms 2024-04-17T14:58:58.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 820 0.56 MB/sec execute 155 sec latency 4282.484 ms 2024-04-17T14:58:59.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 823 0.56 MB/sec execute 156 sec latency 5062.919 ms 2024-04-17T14:59:00.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 827 0.55 MB/sec execute 157 sec latency 3206.063 ms 2024-04-17T14:59:01.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 829 0.55 MB/sec execute 158 sec latency 3225.195 ms 2024-04-17T14:59:02.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 834 0.55 MB/sec execute 159 sec latency 3158.160 ms 2024-04-17T14:59:03.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 835 0.54 MB/sec execute 160 sec latency 3228.642 ms 2024-04-17T14:59:04.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:59:04.370 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:59:04.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 838 0.54 MB/sec execute 161 sec latency 3791.825 ms 2024-04-17T14:59:05.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 841 0.54 MB/sec execute 162 sec latency 3008.143 ms 2024-04-17T14:59:06.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 845 0.54 MB/sec execute 163 sec latency 2794.043 ms 2024-04-17T14:59:07.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 851 0.53 MB/sec execute 164 sec latency 3794.168 ms 2024-04-17T14:59:08.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 856 0.53 MB/sec execute 165 sec latency 4465.279 ms 2024-04-17T14:59:09.612 INFO:tasks.workunit.client.0.smithi016.stdout: 10 857 0.53 MB/sec execute 166 sec latency 2831.743 ms 2024-04-17T14:59:10.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 861 0.53 MB/sec execute 167 sec latency 3831.915 ms 2024-04-17T14:59:11.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 868 0.52 MB/sec execute 168 sec latency 4555.673 ms 2024-04-17T14:59:11.852 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:20:36.219 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:11.855 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:20:36.222 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:11.925 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:20:36.292 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:11.995 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:20:36.303 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:11.997 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:20:36.315 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:11.999 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:20:36.307 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:12.003 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:20:36.321 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:12.094 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:20:36.412 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:12.095 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:20:36.403 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T14:59:12.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 873 0.52 MB/sec execute 169 sec latency 4790.120 ms 2024-04-17T14:59:13.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 875 0.52 MB/sec execute 170 sec latency 2947.943 ms 2024-04-17T14:59:14.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 877 0.51 MB/sec execute 171 sec latency 2913.458 ms 2024-04-17T14:59:15.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 883 0.51 MB/sec execute 172 sec latency 3425.634 ms 2024-04-17T14:59:16.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 885 0.51 MB/sec execute 173 sec latency 2408.768 ms 2024-04-17T14:59:17.613 INFO:tasks.workunit.client.0.smithi016.stdout: 10 887 0.51 MB/sec execute 174 sec latency 3408.881 ms 2024-04-17T14:59:18.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 892 0.50 MB/sec execute 175 sec latency 4074.697 ms 2024-04-17T14:59:19.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 894 0.50 MB/sec execute 176 sec latency 4019.524 ms 2024-04-17T14:59:20.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 898 0.50 MB/sec execute 177 sec latency 2583.500 ms 2024-04-17T14:59:21.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 899 0.50 MB/sec execute 178 sec latency 1331.687 ms 2024-04-17T14:59:22.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 901 0.49 MB/sec execute 179 sec latency 2165.080 ms 2024-04-17T14:59:23.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 904 0.49 MB/sec execute 180 sec latency 3164.512 ms 2024-04-17T14:59:24.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 907 0.49 MB/sec execute 181 sec latency 4163.395 ms 2024-04-17T14:59:25.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 909 0.49 MB/sec execute 182 sec latency 4299.734 ms 2024-04-17T14:59:26.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 916 0.49 MB/sec execute 183 sec latency 3694.018 ms 2024-04-17T14:59:27.614 INFO:tasks.workunit.client.0.smithi016.stdout: 10 921 0.48 MB/sec execute 184 sec latency 3696.323 ms 2024-04-17T14:59:28.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 922 0.48 MB/sec execute 185 sec latency 3829.921 ms 2024-04-17T14:59:29.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 922 0.48 MB/sec execute 186 sec latency 3872.596 ms 2024-04-17T14:59:30.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 924 0.48 MB/sec execute 187 sec latency 4744.334 ms 2024-04-17T14:59:31.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 930 0.47 MB/sec execute 188 sec latency 4639.552 ms 2024-04-17T14:59:32.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 933 0.47 MB/sec execute 189 sec latency 4429.621 ms 2024-04-17T14:59:33.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 936 0.47 MB/sec execute 190 sec latency 5429.771 ms 2024-04-17T14:59:34.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:59:34.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:59:34.615 INFO:tasks.workunit.client.0.smithi016.stdout: 10 938 0.47 MB/sec execute 191 sec latency 5862.723 ms 2024-04-17T14:59:35.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 942 0.47 MB/sec execute 192 sec latency 4533.641 ms 2024-04-17T14:59:36.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 946 0.46 MB/sec execute 193 sec latency 4823.252 ms 2024-04-17T14:59:37.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 947 0.46 MB/sec execute 194 sec latency 2676.976 ms 2024-04-17T14:59:38.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 948 0.46 MB/sec execute 195 sec latency 3592.578 ms 2024-04-17T14:59:39.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 953 0.46 MB/sec execute 196 sec latency 4592.714 ms 2024-04-17T14:59:40.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 956 0.46 MB/sec execute 197 sec latency 5301.973 ms 2024-04-17T14:59:41.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 957 0.45 MB/sec execute 198 sec latency 2734.600 ms 2024-04-17T14:59:42.616 INFO:tasks.workunit.client.0.smithi016.stdout: 10 958 0.45 MB/sec execute 199 sec latency 3129.163 ms 2024-04-17T14:59:43.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 959 0.45 MB/sec execute 200 sec latency 3535.093 ms 2024-04-17T14:59:44.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 961 0.45 MB/sec execute 201 sec latency 3601.795 ms 2024-04-17T14:59:45.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 969 0.45 MB/sec execute 202 sec latency 4114.835 ms 2024-04-17T14:59:46.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 971 0.45 MB/sec execute 203 sec latency 2560.123 ms 2024-04-17T14:59:47.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 976 0.44 MB/sec execute 204 sec latency 3560.292 ms 2024-04-17T14:59:48.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 984 0.45 MB/sec execute 205 sec latency 4475.477 ms 2024-04-17T14:59:49.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 987 0.44 MB/sec execute 206 sec latency 2802.587 ms 2024-04-17T14:59:50.617 INFO:tasks.workunit.client.0.smithi016.stdout: 10 989 0.44 MB/sec execute 207 sec latency 3022.050 ms 2024-04-17T14:59:51.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 991 0.44 MB/sec execute 208 sec latency 2670.330 ms 2024-04-17T14:59:52.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 992 0.44 MB/sec execute 209 sec latency 3670.403 ms 2024-04-17T14:59:53.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 994 0.44 MB/sec execute 210 sec latency 4201.823 ms 2024-04-17T14:59:54.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 997 0.44 MB/sec execute 211 sec latency 4316.622 ms 2024-04-17T14:59:55.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1002 0.44 MB/sec execute 212 sec latency 3295.469 ms 2024-04-17T14:59:56.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1005 0.44 MB/sec execute 213 sec latency 2933.725 ms 2024-04-17T14:59:57.618 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1007 0.44 MB/sec execute 214 sec latency 2261.457 ms 2024-04-17T14:59:58.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1013 0.44 MB/sec execute 215 sec latency 2330.930 ms 2024-04-17T14:59:59.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1017 0.44 MB/sec execute 216 sec latency 3042.526 ms 2024-04-17T15:00:00.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1020 0.44 MB/sec execute 217 sec latency 3848.060 ms 2024-04-17T15:00:01.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1026 0.44 MB/sec execute 218 sec latency 4138.178 ms 2024-04-17T15:00:02.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1029 0.44 MB/sec execute 219 sec latency 2210.796 ms 2024-04-17T15:00:03.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1032 0.44 MB/sec execute 220 sec latency 2635.930 ms 2024-04-17T15:00:04.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:00:04.490 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:00:04.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1039 0.45 MB/sec execute 221 sec latency 3241.001 ms 2024-04-17T15:00:05.619 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1045 0.45 MB/sec execute 222 sec latency 4182.889 ms 2024-04-17T15:00:06.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1052 0.44 MB/sec execute 223 sec latency 1328.261 ms 2024-04-17T15:00:07.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1054 0.45 MB/sec execute 224 sec latency 1840.270 ms 2024-04-17T15:00:08.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1062 0.44 MB/sec execute 225 sec latency 2708.039 ms 2024-04-17T15:00:09.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1068 0.44 MB/sec execute 226 sec latency 3050.838 ms 2024-04-17T15:00:10.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1072 0.44 MB/sec execute 227 sec latency 1786.117 ms 2024-04-17T15:00:11.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1075 0.44 MB/sec execute 228 sec latency 2019.124 ms 2024-04-17T15:00:12.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1079 0.44 MB/sec execute 229 sec latency 2417.946 ms 2024-04-17T15:00:13.620 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1081 0.44 MB/sec execute 230 sec latency 2679.866 ms 2024-04-17T15:00:14.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1085 0.44 MB/sec execute 231 sec latency 2730.976 ms 2024-04-17T15:00:15.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1088 0.44 MB/sec execute 232 sec latency 3596.541 ms 2024-04-17T15:00:16.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1092 0.43 MB/sec execute 233 sec latency 2881.344 ms 2024-04-17T15:00:17.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1095 0.43 MB/sec execute 234 sec latency 2248.197 ms 2024-04-17T15:00:18.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1096 0.43 MB/sec execute 235 sec latency 3248.272 ms 2024-04-17T15:00:19.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1104 0.43 MB/sec execute 236 sec latency 3514.085 ms 2024-04-17T15:00:20.621 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1106 0.43 MB/sec execute 237 sec latency 4034.405 ms 2024-04-17T15:00:21.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1110 0.43 MB/sec execute 238 sec latency 4109.808 ms 2024-04-17T15:00:22.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1117 0.42 MB/sec execute 239 sec latency 2862.321 ms 2024-04-17T15:00:23.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1120 0.42 MB/sec execute 240 sec latency 3862.459 ms 2024-04-17T15:00:24.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1124 0.42 MB/sec execute 241 sec latency 4862.584 ms 2024-04-17T15:00:25.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1127 0.42 MB/sec execute 242 sec latency 5188.189 ms 2024-04-17T15:00:26.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1131 0.42 MB/sec execute 243 sec latency 4054.956 ms 2024-04-17T15:00:27.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1137 0.42 MB/sec execute 244 sec latency 3535.845 ms 2024-04-17T15:00:28.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1142 0.41 MB/sec execute 245 sec latency 2593.882 ms 2024-04-17T15:00:29.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1145 0.41 MB/sec execute 246 sec latency 2706.340 ms 2024-04-17T15:00:30.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1146 0.41 MB/sec execute 247 sec latency 3706.425 ms 2024-04-17T15:00:31.622 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1146 0.41 MB/sec execute 248 sec latency 4706.503 ms 2024-04-17T15:00:32.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1149 0.41 MB/sec execute 249 sec latency 5126.180 ms 2024-04-17T15:00:33.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1156 0.41 MB/sec execute 250 sec latency 5114.065 ms 2024-04-17T15:00:34.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:00:34.575 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:00:34.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1158 0.41 MB/sec execute 251 sec latency 2061.403 ms 2024-04-17T15:00:35.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1160 0.40 MB/sec execute 252 sec latency 2724.032 ms 2024-04-17T15:00:36.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1165 0.40 MB/sec execute 253 sec latency 3174.646 ms 2024-04-17T15:00:37.623 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1170 0.40 MB/sec execute 254 sec latency 2528.026 ms 2024-04-17T15:00:38.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1171 0.40 MB/sec execute 255 sec latency 1404.605 ms 2024-04-17T15:00:39.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1171 0.40 MB/sec execute 256 sec latency 2388.019 ms 2024-04-17T15:00:40.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1176 0.40 MB/sec execute 257 sec latency 3187.405 ms 2024-04-17T15:00:41.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1179 0.39 MB/sec execute 258 sec latency 3618.647 ms 2024-04-17T15:00:42.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1182 0.39 MB/sec execute 259 sec latency 3848.003 ms 2024-04-17T15:00:43.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1187 0.39 MB/sec execute 260 sec latency 2707.402 ms 2024-04-17T15:00:44.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1195 0.39 MB/sec execute 261 sec latency 2213.853 ms 2024-04-17T15:00:45.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1197 0.39 MB/sec execute 262 sec latency 1868.591 ms 2024-04-17T15:00:46.624 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1203 0.39 MB/sec execute 263 sec latency 2768.751 ms 2024-04-17T15:00:47.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1205 0.39 MB/sec execute 264 sec latency 2209.830 ms 2024-04-17T15:00:48.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1206 0.39 MB/sec execute 265 sec latency 2306.923 ms 2024-04-17T15:00:49.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1208 0.38 MB/sec execute 266 sec latency 3048.173 ms 2024-04-17T15:00:50.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1209 0.38 MB/sec execute 267 sec latency 3375.038 ms 2024-04-17T15:00:51.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1212 0.38 MB/sec execute 268 sec latency 3827.982 ms 2024-04-17T15:00:52.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1213 0.38 MB/sec execute 269 sec latency 4599.592 ms 2024-04-17T15:00:53.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1217 0.38 MB/sec execute 270 sec latency 4937.146 ms 2024-04-17T15:00:54.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1218 0.38 MB/sec execute 271 sec latency 2246.753 ms 2024-04-17T15:00:55.625 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1221 0.38 MB/sec execute 272 sec latency 3196.325 ms 2024-04-17T15:00:56.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1224 0.37 MB/sec execute 273 sec latency 4008.199 ms 2024-04-17T15:00:57.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1229 0.37 MB/sec execute 274 sec latency 3768.053 ms 2024-04-17T15:00:58.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1233 0.37 MB/sec execute 275 sec latency 3794.149 ms 2024-04-17T15:00:59.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1236 0.37 MB/sec execute 276 sec latency 2726.501 ms 2024-04-17T15:01:00.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1237 0.37 MB/sec execute 277 sec latency 2678.580 ms 2024-04-17T15:01:01.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1242 0.37 MB/sec execute 278 sec latency 2987.861 ms 2024-04-17T15:01:02.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1248 0.37 MB/sec execute 279 sec latency 1854.744 ms 2024-04-17T15:01:03.626 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1253 0.37 MB/sec execute 280 sec latency 1761.668 ms 2024-04-17T15:01:04.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1255 0.37 MB/sec execute 281 sec latency 2050.338 ms 2024-04-17T15:01:04.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:04.645 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:05.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1257 0.36 MB/sec execute 282 sec latency 2956.627 ms 2024-04-17T15:01:06.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1259 0.36 MB/sec execute 283 sec latency 3456.662 ms 2024-04-17T15:01:07.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1259 0.36 MB/sec execute 284 sec latency 4401.917 ms 2024-04-17T15:01:08.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1260 0.36 MB/sec execute 285 sec latency 4800.489 ms 2024-04-17T15:01:09.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1262 0.36 MB/sec execute 286 sec latency 4094.249 ms 2024-04-17T15:01:10.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1274 0.37 MB/sec execute 287 sec latency 4162.966 ms 2024-04-17T15:01:11.627 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1290 0.38 MB/sec execute 288 sec latency 3523.344 ms 2024-04-17T15:01:12.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1292 0.38 MB/sec execute 289 sec latency 4523.486 ms 2024-04-17T15:01:13.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1299 0.38 MB/sec execute 290 sec latency 4589.413 ms 2024-04-17T15:01:14.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1301 0.38 MB/sec execute 291 sec latency 4243.747 ms 2024-04-17T15:01:15.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1307 0.39 MB/sec execute 292 sec latency 5243.819 ms 2024-04-17T15:01:16.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1309 0.39 MB/sec execute 293 sec latency 6243.925 ms 2024-04-17T15:01:17.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1317 0.39 MB/sec execute 294 sec latency 7244.068 ms 2024-04-17T15:01:18.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1322 0.39 MB/sec execute 295 sec latency 7428.857 ms 2024-04-17T15:01:19.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1329 0.40 MB/sec execute 296 sec latency 4428.862 ms 2024-04-17T15:01:20.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1330 0.40 MB/sec execute 297 sec latency 5428.934 ms 2024-04-17T15:01:21.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1350 0.41 MB/sec execute 298 sec latency 5567.530 ms 2024-04-17T15:01:22.628 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1352 0.41 MB/sec execute 299 sec latency 4901.762 ms 2024-04-17T15:01:23.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1358 0.41 MB/sec execute 300 sec latency 4988.283 ms 2024-04-17T15:01:24.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1361 0.41 MB/sec execute 301 sec latency 3830.011 ms 2024-04-17T15:01:25.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1361 0.41 MB/sec execute 302 sec latency 4830.144 ms 2024-04-17T15:01:26.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1368 0.42 MB/sec execute 303 sec latency 5309.732 ms 2024-04-17T15:01:27.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1371 0.41 MB/sec execute 304 sec latency 5009.967 ms 2024-04-17T15:01:28.629 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1378 0.41 MB/sec execute 305 sec latency 5262.291 ms 2024-04-17T15:01:29.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1379 0.41 MB/sec execute 306 sec latency 1751.802 ms 2024-04-17T15:01:30.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1381 0.41 MB/sec execute 307 sec latency 2751.898 ms 2024-04-17T15:01:31.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1383 0.41 MB/sec execute 308 sec latency 3391.557 ms 2024-04-17T15:01:32.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1384 0.41 MB/sec execute 309 sec latency 3761.883 ms 2024-04-17T15:01:33.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1397 0.42 MB/sec execute 310 sec latency 3944.057 ms 2024-04-17T15:01:34.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1400 0.41 MB/sec execute 311 sec latency 3542.591 ms 2024-04-17T15:01:34.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:34.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:35.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1404 0.41 MB/sec execute 312 sec latency 3770.089 ms 2024-04-17T15:01:36.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1405 0.41 MB/sec execute 313 sec latency 4503.330 ms 2024-04-17T15:01:37.630 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1407 0.41 MB/sec execute 314 sec latency 4885.930 ms 2024-04-17T15:01:38.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1409 0.41 MB/sec execute 315 sec latency 4607.779 ms 2024-04-17T15:01:39.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1413 0.41 MB/sec execute 316 sec latency 4517.697 ms 2024-04-17T15:01:40.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1414 0.41 MB/sec execute 317 sec latency 5205.715 ms 2024-04-17T15:01:41.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1426 0.41 MB/sec execute 318 sec latency 3214.540 ms 2024-04-17T15:01:42.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1430 0.41 MB/sec execute 319 sec latency 4214.614 ms 2024-04-17T15:01:43.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1433 0.41 MB/sec execute 320 sec latency 4888.278 ms 2024-04-17T15:01:44.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1438 0.41 MB/sec execute 321 sec latency 3271.848 ms 2024-04-17T15:01:45.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1445 0.41 MB/sec execute 322 sec latency 3282.021 ms 2024-04-17T15:01:46.631 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1448 0.41 MB/sec execute 323 sec latency 2083.582 ms 2024-04-17T15:01:47.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1450 0.41 MB/sec execute 324 sec latency 2895.565 ms 2024-04-17T15:01:48.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1454 0.41 MB/sec execute 325 sec latency 3292.678 ms 2024-04-17T15:01:49.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1457 0.40 MB/sec execute 326 sec latency 3743.993 ms 2024-04-17T15:01:50.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1459 0.40 MB/sec execute 327 sec latency 3640.228 ms 2024-04-17T15:01:51.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1463 0.40 MB/sec execute 328 sec latency 2502.919 ms 2024-04-17T15:01:52.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1470 0.40 MB/sec execute 329 sec latency 2733.193 ms 2024-04-17T15:01:53.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1472 0.40 MB/sec execute 330 sec latency 2857.637 ms 2024-04-17T15:01:54.632 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1476 0.40 MB/sec execute 331 sec latency 3253.679 ms 2024-04-17T15:01:55.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1480 0.40 MB/sec execute 332 sec latency 3167.041 ms 2024-04-17T15:01:56.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1483 0.40 MB/sec execute 333 sec latency 2650.413 ms 2024-04-17T15:01:57.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1486 0.40 MB/sec execute 334 sec latency 2992.697 ms 2024-04-17T15:01:58.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1491 0.39 MB/sec execute 335 sec latency 2913.228 ms 2024-04-17T15:01:59.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1494 0.39 MB/sec execute 336 sec latency 3641.348 ms 2024-04-17T15:02:00.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1504 0.39 MB/sec execute 337 sec latency 2783.132 ms 2024-04-17T15:02:01.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1507 0.39 MB/sec execute 338 sec latency 2554.016 ms 2024-04-17T15:02:02.633 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1508 0.39 MB/sec execute 339 sec latency 2845.406 ms 2024-04-17T15:02:03.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1515 0.39 MB/sec execute 340 sec latency 2521.832 ms 2024-04-17T15:02:04.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1518 0.39 MB/sec execute 341 sec latency 2310.050 ms 2024-04-17T15:02:04.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:02:04.762 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:02:05.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1520 0.39 MB/sec execute 342 sec latency 3015.717 ms 2024-04-17T15:02:06.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1525 0.39 MB/sec execute 343 sec latency 2484.009 ms 2024-04-17T15:02:07.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1529 0.39 MB/sec execute 344 sec latency 2265.597 ms 2024-04-17T15:02:08.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1531 0.38 MB/sec execute 345 sec latency 2527.978 ms 2024-04-17T15:02:09.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1534 0.38 MB/sec execute 346 sec latency 3496.195 ms 2024-04-17T15:02:10.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1541 0.38 MB/sec execute 347 sec latency 3747.716 ms 2024-04-17T15:02:11.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1543 0.38 MB/sec execute 348 sec latency 3124.515 ms 2024-04-17T15:02:12.634 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1543 0.38 MB/sec execute 349 sec latency 4124.657 ms 2024-04-17T15:02:13.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1550 0.38 MB/sec execute 350 sec latency 5124.792 ms 2024-04-17T15:02:14.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1554 0.38 MB/sec execute 351 sec latency 5797.386 ms 2024-04-17T15:02:15.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1555 0.38 MB/sec execute 352 sec latency 4833.611 ms 2024-04-17T15:02:16.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1562 0.38 MB/sec execute 353 sec latency 3449.179 ms 2024-04-17T15:02:17.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1565 0.38 MB/sec execute 354 sec latency 4153.589 ms 2024-04-17T15:02:18.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1570 0.37 MB/sec execute 355 sec latency 1574.321 ms 2024-04-17T15:02:19.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1572 0.37 MB/sec execute 356 sec latency 1818.487 ms 2024-04-17T15:02:20.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1578 0.37 MB/sec execute 357 sec latency 2135.617 ms 2024-04-17T15:02:21.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1578 0.37 MB/sec execute 358 sec latency 3135.699 ms 2024-04-17T15:02:22.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1581 0.37 MB/sec execute 359 sec latency 4135.809 ms 2024-04-17T15:02:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1588 0.37 MB/sec execute 360 sec latency 4747.703 ms 2024-04-17T15:02:24.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1588 0.37 MB/sec execute 361 sec latency 4359.046 ms 2024-04-17T15:02:25.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1592 0.37 MB/sec execute 362 sec latency 5359.179 ms 2024-04-17T15:02:26.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1595 0.37 MB/sec execute 363 sec latency 5750.326 ms 2024-04-17T15:02:27.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1600 0.37 MB/sec execute 364 sec latency 4388.439 ms 2024-04-17T15:02:28.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1603 0.36 MB/sec execute 365 sec latency 5388.584 ms 2024-04-17T15:02:29.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1605 0.36 MB/sec execute 366 sec latency 6388.637 ms 2024-04-17T15:02:30.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1605 0.36 MB/sec execute 367 sec latency 7388.749 ms 2024-04-17T15:02:31.636 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1610 0.36 MB/sec execute 368 sec latency 8191.585 ms 2024-04-17T15:02:32.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1615 0.36 MB/sec execute 369 sec latency 6609.338 ms 2024-04-17T15:02:33.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1618 0.36 MB/sec execute 370 sec latency 7140.774 ms 2024-04-17T15:02:34.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1620 0.36 MB/sec execute 371 sec latency 3306.035 ms 2024-04-17T15:02:34.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:02:34.826 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:02:35.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1629 0.36 MB/sec execute 372 sec latency 3777.023 ms 2024-04-17T15:02:36.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1633 0.36 MB/sec execute 373 sec latency 4107.358 ms 2024-04-17T15:02:37.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1637 0.36 MB/sec execute 374 sec latency 4023.399 ms 2024-04-17T15:02:38.637 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1638 0.36 MB/sec execute 375 sec latency 3512.009 ms 2024-04-17T15:02:39.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1639 0.35 MB/sec execute 376 sec latency 4512.203 ms 2024-04-17T15:02:40.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1645 0.35 MB/sec execute 377 sec latency 4948.154 ms 2024-04-17T15:02:41.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1646 0.35 MB/sec execute 378 sec latency 4231.932 ms 2024-04-17T15:02:42.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1655 0.35 MB/sec execute 379 sec latency 4410.658 ms 2024-04-17T15:02:43.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1656 0.35 MB/sec execute 380 sec latency 3722.991 ms 2024-04-17T15:02:44.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1657 0.35 MB/sec execute 381 sec latency 4432.224 ms 2024-04-17T15:02:45.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1660 0.35 MB/sec execute 382 sec latency 4579.678 ms 2024-04-17T15:02:46.638 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1663 0.35 MB/sec execute 383 sec latency 4448.687 ms 2024-04-17T15:02:47.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1666 0.35 MB/sec execute 384 sec latency 4384.177 ms 2024-04-17T15:02:48.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1676 0.35 MB/sec execute 385 sec latency 3632.009 ms 2024-04-17T15:02:49.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1683 0.35 MB/sec execute 386 sec latency 3887.649 ms 2024-04-17T15:02:50.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1692 0.35 MB/sec execute 387 sec latency 3515.654 ms 2024-04-17T15:02:51.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1696 0.35 MB/sec execute 388 sec latency 2433.999 ms 2024-04-17T15:02:52.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1698 0.34 MB/sec execute 389 sec latency 3204.785 ms 2024-04-17T15:02:53.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1708 0.34 MB/sec execute 390 sec latency 2921.921 ms 2024-04-17T15:02:54.639 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1724 0.34 MB/sec execute 391 sec latency 2459.627 ms 2024-04-17T15:02:55.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1728 0.34 MB/sec execute 392 sec latency 2353.366 ms 2024-04-17T15:02:56.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1731 0.34 MB/sec execute 393 sec latency 2680.961 ms 2024-04-17T15:02:57.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1739 0.34 MB/sec execute 394 sec latency 3145.340 ms 2024-04-17T15:02:58.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1744 0.34 MB/sec execute 395 sec latency 3782.482 ms 2024-04-17T15:02:59.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1749 0.34 MB/sec execute 396 sec latency 3582.545 ms 2024-04-17T15:03:00.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1756 0.34 MB/sec execute 397 sec latency 2954.013 ms 2024-04-17T15:03:01.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1760 0.34 MB/sec execute 398 sec latency 3150.039 ms 2024-04-17T15:03:02.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1765 0.34 MB/sec execute 399 sec latency 3996.887 ms 2024-04-17T15:03:03.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1774 0.34 MB/sec execute 400 sec latency 4884.551 ms 2024-04-17T15:03:04.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1784 0.34 MB/sec execute 401 sec latency 3442.883 ms 2024-04-17T15:03:04.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:03:04.886 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:03:05.640 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1786 0.33 MB/sec execute 402 sec latency 3168.621 ms 2024-04-17T15:03:06.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1786 0.33 MB/sec execute 403 sec latency 4168.750 ms 2024-04-17T15:03:07.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1796 0.33 MB/sec execute 404 sec latency 5168.858 ms 2024-04-17T15:03:08.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1803 0.33 MB/sec execute 405 sec latency 5517.129 ms 2024-04-17T15:03:09.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1811 0.33 MB/sec execute 406 sec latency 2404.409 ms 2024-04-17T15:03:10.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1811 0.33 MB/sec execute 407 sec latency 2651.876 ms 2024-04-17T15:03:11.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1821 0.33 MB/sec execute 408 sec latency 3327.067 ms 2024-04-17T15:03:12.641 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1841 0.33 MB/sec execute 409 sec latency 2696.048 ms 2024-04-17T15:03:13.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1847 0.33 MB/sec execute 410 sec latency 1627.102 ms 2024-04-17T15:03:14.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1861 0.33 MB/sec execute 411 sec latency 2434.516 ms 2024-04-17T15:03:15.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1864 0.33 MB/sec execute 412 sec latency 2535.836 ms 2024-04-17T15:03:16.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1872 0.33 MB/sec execute 413 sec latency 3014.794 ms 2024-04-17T15:03:17.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1872 0.33 MB/sec execute 414 sec latency 3122.265 ms 2024-04-17T15:03:18.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1883 0.33 MB/sec execute 415 sec latency 2954.639 ms 2024-04-17T15:03:19.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1893 0.33 MB/sec execute 416 sec latency 2773.022 ms 2024-04-17T15:03:20.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1906 0.33 MB/sec execute 417 sec latency 2759.992 ms 2024-04-17T15:03:21.642 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1911 0.33 MB/sec execute 418 sec latency 2668.967 ms 2024-04-17T15:03:22.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1911 0.32 MB/sec execute 419 sec latency 3373.092 ms 2024-04-17T15:03:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1923 0.32 MB/sec execute 420 sec latency 3664.718 ms 2024-04-17T15:03:24.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1927 0.32 MB/sec execute 421 sec latency 3354.273 ms 2024-04-17T15:03:25.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1937 0.32 MB/sec execute 422 sec latency 3502.642 ms 2024-04-17T15:03:26.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1954 0.32 MB/sec execute 423 sec latency 2699.092 ms 2024-04-17T15:03:27.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1962 0.32 MB/sec execute 424 sec latency 2267.075 ms 2024-04-17T15:03:28.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1970 0.32 MB/sec execute 425 sec latency 2704.783 ms 2024-04-17T15:03:29.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1975 0.32 MB/sec execute 426 sec latency 2962.186 ms 2024-04-17T15:03:30.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1986 0.32 MB/sec execute 427 sec latency 3369.552 ms 2024-04-17T15:03:31.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1992 0.32 MB/sec execute 428 sec latency 3655.327 ms 2024-04-17T15:03:32.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1999 0.32 MB/sec execute 429 sec latency 3984.764 ms 2024-04-17T15:03:33.643 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2006 0.32 MB/sec execute 430 sec latency 4309.146 ms 2024-04-17T15:03:34.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2006 0.32 MB/sec execute 431 sec latency 4105.631 ms 2024-04-17T15:03:34.963 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:03:34.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:03:35.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2013 0.32 MB/sec execute 432 sec latency 4213.625 ms 2024-04-17T15:03:36.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2035 0.32 MB/sec execute 433 sec latency 3324.643 ms 2024-04-17T15:03:37.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2043 0.32 MB/sec execute 434 sec latency 1303.813 ms 2024-04-17T15:03:38.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2062 0.32 MB/sec execute 435 sec latency 1647.572 ms 2024-04-17T15:03:39.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2066 0.32 MB/sec execute 436 sec latency 2647.696 ms 2024-04-17T15:03:40.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2074 0.31 MB/sec execute 437 sec latency 3023.855 ms 2024-04-17T15:03:41.644 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2079 0.31 MB/sec execute 438 sec latency 3249.386 ms 2024-04-17T15:03:42.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2089 0.32 MB/sec execute 439 sec latency 4008.693 ms 2024-04-17T15:03:43.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2089 0.32 MB/sec execute 440 sec latency 4006.886 ms 2024-04-17T15:03:44.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2103 0.32 MB/sec execute 441 sec latency 5007.040 ms 2024-04-17T15:03:45.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2112 0.32 MB/sec execute 442 sec latency 5017.768 ms 2024-04-17T15:03:46.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2122 0.32 MB/sec execute 443 sec latency 3678.017 ms 2024-04-17T15:03:47.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2127 0.32 MB/sec execute 444 sec latency 3215.329 ms 2024-04-17T15:03:48.645 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2132 0.31 MB/sec execute 445 sec latency 4215.478 ms 2024-04-17T15:03:49.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2150 0.32 MB/sec execute 446 sec latency 5215.602 ms 2024-04-17T15:03:50.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2162 0.32 MB/sec execute 447 sec latency 5748.696 ms 2024-04-17T15:03:51.145 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:25:15.512 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.165 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:25:15.531 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.256 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:25:15.562 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.259 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:25:15.564 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.277 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:25:15.643 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.282 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:25:15.598 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.286 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:25:15.603 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.467 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:25:15.772 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.478 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:25:15.794 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:03:51.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2171 0.32 MB/sec execute 448 sec latency 4063.649 ms 2024-04-17T15:03:52.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2180 0.32 MB/sec execute 449 sec latency 4970.558 ms 2024-04-17T15:03:53.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2187 0.32 MB/sec execute 450 sec latency 5129.476 ms 2024-04-17T15:03:54.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2202 0.31 MB/sec execute 451 sec latency 4443.684 ms 2024-04-17T15:03:55.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2204 0.31 MB/sec execute 452 sec latency 2841.134 ms 2024-04-17T15:03:56.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2206 0.31 MB/sec execute 453 sec latency 3841.224 ms 2024-04-17T15:03:57.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2211 0.31 MB/sec execute 454 sec latency 4528.008 ms 2024-04-17T15:03:58.646 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2216 0.31 MB/sec execute 455 sec latency 5440.700 ms 2024-04-17T15:03:59.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2224 0.31 MB/sec execute 456 sec latency 4348.611 ms 2024-04-17T15:04:00.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2236 0.31 MB/sec execute 457 sec latency 4558.848 ms 2024-04-17T15:04:01.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2239 0.31 MB/sec execute 458 sec latency 3595.086 ms 2024-04-17T15:04:02.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2242 0.31 MB/sec execute 459 sec latency 4595.180 ms 2024-04-17T15:04:03.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2246 0.31 MB/sec execute 460 sec latency 4763.207 ms 2024-04-17T15:04:04.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2247 0.31 MB/sec execute 461 sec latency 4992.766 ms 2024-04-17T15:04:05.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:04:05.031 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:04:05.647 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2254 0.31 MB/sec execute 462 sec latency 4601.148 ms 2024-04-17T15:04:06.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2259 0.31 MB/sec execute 463 sec latency 4400.743 ms 2024-04-17T15:04:07.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2265 0.31 MB/sec execute 464 sec latency 4967.235 ms 2024-04-17T15:04:08.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2268 0.31 MB/sec execute 465 sec latency 4699.534 ms 2024-04-17T15:04:09.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2276 0.31 MB/sec execute 466 sec latency 5324.747 ms 2024-04-17T15:04:10.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2281 0.31 MB/sec execute 467 sec latency 5058.854 ms 2024-04-17T15:04:11.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2286 0.31 MB/sec execute 468 sec latency 5153.808 ms 2024-04-17T15:04:12.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2286 0.31 MB/sec execute 469 sec latency 3374.815 ms 2024-04-17T15:04:13.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2289 0.31 MB/sec execute 470 sec latency 4374.911 ms 2024-04-17T15:04:14.648 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2295 0.31 MB/sec execute 471 sec latency 4794.334 ms 2024-04-17T15:04:15.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2300 0.31 MB/sec execute 472 sec latency 5135.610 ms 2024-04-17T15:04:16.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2307 0.31 MB/sec execute 473 sec latency 2627.068 ms 2024-04-17T15:04:17.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2307 0.31 MB/sec execute 474 sec latency 3574.100 ms 2024-04-17T15:04:18.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2307 0.31 MB/sec execute 475 sec latency 4574.225 ms 2024-04-17T15:04:19.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2307 0.31 MB/sec execute 476 sec latency 5055.184 ms 2024-04-17T15:04:20.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2309 0.31 MB/sec execute 477 sec latency 4735.447 ms 2024-04-17T15:04:21.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2310 0.31 MB/sec execute 478 sec latency 5735.559 ms 2024-04-17T15:04:22.649 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2310 0.31 MB/sec execute 479 sec latency 6735.692 ms 2024-04-17T15:04:23.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2310 0.31 MB/sec execute 480 sec latency 7662.855 ms 2024-04-17T15:04:24.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2311 0.31 MB/sec execute 481 sec latency 8662.981 ms 2024-04-17T15:04:25.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2313 0.31 MB/sec execute 482 sec latency 9663.129 ms 2024-04-17T15:04:26.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2317 0.31 MB/sec execute 483 sec latency 10663.197 ms 2024-04-17T15:04:27.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2323 0.31 MB/sec execute 484 sec latency 11663.247 ms 2024-04-17T15:04:28.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2327 0.31 MB/sec execute 485 sec latency 12221.351 ms 2024-04-17T15:04:29.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2328 0.31 MB/sec execute 486 sec latency 4463.330 ms 2024-04-17T15:04:30.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2333 0.31 MB/sec execute 487 sec latency 5021.297 ms 2024-04-17T15:04:31.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2340 0.31 MB/sec execute 488 sec latency 4213.341 ms 2024-04-17T15:04:32.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2343 0.31 MB/sec execute 489 sec latency 3457.516 ms 2024-04-17T15:04:33.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2350 0.31 MB/sec execute 490 sec latency 3436.828 ms 2024-04-17T15:04:34.650 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2353 0.31 MB/sec execute 491 sec latency 3658.314 ms 2024-04-17T15:04:35.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:04:35.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:04:35.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2356 0.31 MB/sec execute 492 sec latency 2720.398 ms 2024-04-17T15:04:36.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2359 0.31 MB/sec execute 493 sec latency 2912.296 ms 2024-04-17T15:04:37.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2362 0.30 MB/sec execute 494 sec latency 2867.995 ms 2024-04-17T15:04:38.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2364 0.30 MB/sec execute 495 sec latency 2725.603 ms 2024-04-17T15:04:39.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2367 0.30 MB/sec execute 496 sec latency 2664.790 ms 2024-04-17T15:04:40.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2368 0.30 MB/sec execute 497 sec latency 2594.420 ms 2024-04-17T15:04:41.651 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2373 0.30 MB/sec execute 498 sec latency 2658.057 ms 2024-04-17T15:04:42.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2376 0.30 MB/sec execute 499 sec latency 3136.617 ms 2024-04-17T15:04:43.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2380 0.30 MB/sec execute 500 sec latency 2261.097 ms 2024-04-17T15:04:44.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2385 0.30 MB/sec execute 501 sec latency 2493.402 ms 2024-04-17T15:04:45.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2388 0.30 MB/sec execute 502 sec latency 2622.489 ms 2024-04-17T15:04:46.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2390 0.30 MB/sec execute 503 sec latency 3513.249 ms 2024-04-17T15:04:47.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2393 0.30 MB/sec execute 504 sec latency 3751.433 ms 2024-04-17T15:04:48.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2395 0.30 MB/sec execute 505 sec latency 3828.793 ms 2024-04-17T15:04:49.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2398 0.30 MB/sec execute 506 sec latency 4075.206 ms 2024-04-17T15:04:50.652 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2400 0.30 MB/sec execute 507 sec latency 2101.896 ms 2024-04-17T15:04:51.372 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:26:15.738 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.375 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:26:15.741 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.405 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:26:15.771 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.500 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:26:15.806 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.504 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:26:15.820 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.507 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:26:15.813 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.510 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:26:15.826 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.567 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:26:15.872 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.567 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:26:15.883 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:04:51.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2401 0.30 MB/sec execute 508 sec latency 2512.045 ms 2024-04-17T15:04:52.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2402 0.30 MB/sec execute 509 sec latency 3367.690 ms 2024-04-17T15:04:53.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2405 0.30 MB/sec execute 510 sec latency 4175.128 ms 2024-04-17T15:04:54.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2407 0.30 MB/sec execute 511 sec latency 3864.333 ms 2024-04-17T15:04:55.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2407 0.30 MB/sec execute 512 sec latency 2886.718 ms 2024-04-17T15:04:56.653 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2410 0.30 MB/sec execute 513 sec latency 2784.186 ms 2024-04-17T15:04:57.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2412 0.30 MB/sec execute 514 sec latency 2923.752 ms 2024-04-17T15:04:58.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2414 0.30 MB/sec execute 515 sec latency 2447.851 ms 2024-04-17T15:04:59.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2418 0.29 MB/sec execute 516 sec latency 1461.346 ms 2024-04-17T15:05:00.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2419 0.29 MB/sec execute 517 sec latency 1740.109 ms 2024-04-17T15:05:01.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2422 0.29 MB/sec execute 518 sec latency 2681.045 ms 2024-04-17T15:05:02.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2423 0.29 MB/sec execute 519 sec latency 3681.169 ms 2024-04-17T15:05:03.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2426 0.29 MB/sec execute 520 sec latency 3746.869 ms 2024-04-17T15:05:04.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2428 0.29 MB/sec execute 521 sec latency 2976.673 ms 2024-04-17T15:05:05.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:05:05.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:05:05.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2430 0.29 MB/sec execute 522 sec latency 3530.751 ms 2024-04-17T15:05:06.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2431 0.29 MB/sec execute 523 sec latency 4103.843 ms 2024-04-17T15:05:07.654 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2433 0.29 MB/sec execute 524 sec latency 4432.495 ms 2024-04-17T15:05:08.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2436 0.29 MB/sec execute 525 sec latency 4580.395 ms 2024-04-17T15:05:09.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2439 0.29 MB/sec execute 526 sec latency 4889.746 ms 2024-04-17T15:05:10.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2439 0.29 MB/sec execute 527 sec latency 3262.890 ms 2024-04-17T15:05:11.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2442 0.29 MB/sec execute 528 sec latency 3490.169 ms 2024-04-17T15:05:12.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2443 0.29 MB/sec execute 529 sec latency 3721.920 ms 2024-04-17T15:05:13.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2446 0.29 MB/sec execute 530 sec latency 3986.784 ms 2024-04-17T15:05:14.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2447 0.29 MB/sec execute 531 sec latency 3444.516 ms 2024-04-17T15:05:15.655 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2450 0.29 MB/sec execute 532 sec latency 3673.744 ms 2024-04-17T15:05:16.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2450 0.29 MB/sec execute 533 sec latency 3427.402 ms 2024-04-17T15:05:17.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2452 0.29 MB/sec execute 534 sec latency 3565.805 ms 2024-04-17T15:05:18.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2453 0.29 MB/sec execute 535 sec latency 3659.585 ms 2024-04-17T15:05:19.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2461 0.29 MB/sec execute 536 sec latency 3939.417 ms 2024-04-17T15:05:20.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2462 0.29 MB/sec execute 537 sec latency 3149.466 ms 2024-04-17T15:05:21.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2464 0.29 MB/sec execute 538 sec latency 2991.542 ms 2024-04-17T15:05:22.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2466 0.29 MB/sec execute 539 sec latency 2993.720 ms 2024-04-17T15:05:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2467 0.29 MB/sec execute 540 sec latency 3174.663 ms 2024-04-17T15:05:24.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2474 0.29 MB/sec execute 541 sec latency 4044.279 ms 2024-04-17T15:05:25.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2477 0.29 MB/sec execute 542 sec latency 2627.790 ms 2024-04-17T15:05:26.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2485 0.29 MB/sec execute 543 sec latency 2921.397 ms 2024-04-17T15:05:27.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2486 0.29 MB/sec execute 544 sec latency 2450.576 ms 2024-04-17T15:05:28.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2488 0.29 MB/sec execute 545 sec latency 2186.666 ms 2024-04-17T15:05:29.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2492 0.29 MB/sec execute 546 sec latency 2383.283 ms 2024-04-17T15:05:30.657 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2494 0.29 MB/sec execute 547 sec latency 3383.430 ms 2024-04-17T15:05:31.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2496 0.29 MB/sec execute 548 sec latency 4186.074 ms 2024-04-17T15:05:32.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2498 0.29 MB/sec execute 549 sec latency 4822.964 ms 2024-04-17T15:05:33.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2500 0.29 MB/sec execute 550 sec latency 4523.737 ms 2024-04-17T15:05:34.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2502 0.29 MB/sec execute 551 sec latency 4915.564 ms 2024-04-17T15:05:35.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:05:35.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:05:35.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2505 0.29 MB/sec execute 552 sec latency 3096.849 ms 2024-04-17T15:05:36.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2507 0.29 MB/sec execute 553 sec latency 3142.474 ms 2024-04-17T15:05:37.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2511 0.28 MB/sec execute 554 sec latency 3500.257 ms 2024-04-17T15:05:38.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2513 0.29 MB/sec execute 555 sec latency 3628.270 ms 2024-04-17T15:05:39.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2515 0.29 MB/sec execute 556 sec latency 4305.457 ms 2024-04-17T15:05:40.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2517 0.29 MB/sec execute 557 sec latency 3444.675 ms 2024-04-17T15:05:41.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2519 0.28 MB/sec execute 558 sec latency 3149.876 ms 2024-04-17T15:05:42.658 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2531 0.29 MB/sec execute 559 sec latency 3039.417 ms 2024-04-17T15:05:43.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2538 0.29 MB/sec execute 560 sec latency 3337.718 ms 2024-04-17T15:05:44.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2541 0.28 MB/sec execute 561 sec latency 2588.433 ms 2024-04-17T15:05:45.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2542 0.28 MB/sec execute 562 sec latency 2536.805 ms 2024-04-17T15:05:46.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2542 0.28 MB/sec execute 563 sec latency 3178.132 ms 2024-04-17T15:05:47.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2544 0.28 MB/sec execute 564 sec latency 3432.864 ms 2024-04-17T15:05:48.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2551 0.28 MB/sec execute 565 sec latency 2724.922 ms 2024-04-17T15:05:49.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2553 0.28 MB/sec execute 566 sec latency 2745.598 ms 2024-04-17T15:05:50.659 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2556 0.28 MB/sec execute 567 sec latency 3148.073 ms 2024-04-17T15:05:51.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2562 0.28 MB/sec execute 568 sec latency 3012.508 ms 2024-04-17T15:05:52.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2563 0.28 MB/sec execute 569 sec latency 2616.065 ms 2024-04-17T15:05:53.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2571 0.28 MB/sec execute 570 sec latency 2561.633 ms 2024-04-17T15:05:54.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2573 0.28 MB/sec execute 571 sec latency 3245.953 ms 2024-04-17T15:05:55.660 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2587 0.29 MB/sec execute 572 sec latency 3399.756 ms 2024-04-17T15:05:56.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2596 0.29 MB/sec execute 573 sec latency 1655.256 ms 2024-04-17T15:05:57.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2597 0.29 MB/sec execute 574 sec latency 2655.354 ms 2024-04-17T15:05:58.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2612 0.30 MB/sec execute 575 sec latency 3156.607 ms 2024-04-17T15:05:59.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2615 0.29 MB/sec execute 576 sec latency 2274.457 ms 2024-04-17T15:06:00.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2621 0.29 MB/sec execute 577 sec latency 2517.573 ms 2024-04-17T15:06:01.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2627 0.29 MB/sec execute 578 sec latency 3201.004 ms 2024-04-17T15:06:02.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2628 0.29 MB/sec execute 579 sec latency 3211.002 ms 2024-04-17T15:06:03.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2629 0.29 MB/sec execute 580 sec latency 2329.390 ms 2024-04-17T15:06:04.661 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2632 0.29 MB/sec execute 581 sec latency 3058.431 ms 2024-04-17T15:06:05.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:06:05.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:06:05.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2634 0.29 MB/sec execute 582 sec latency 4058.560 ms 2024-04-17T15:06:06.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2638 0.29 MB/sec execute 583 sec latency 4165.580 ms 2024-04-17T15:06:07.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2641 0.29 MB/sec execute 584 sec latency 2175.722 ms 2024-04-17T15:06:08.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2642 0.29 MB/sec execute 585 sec latency 2315.917 ms 2024-04-17T15:06:09.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2655 0.30 MB/sec execute 586 sec latency 3273.552 ms 2024-04-17T15:06:10.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2659 0.30 MB/sec execute 587 sec latency 3545.953 ms 2024-04-17T15:06:11.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2661 0.29 MB/sec execute 588 sec latency 3895.707 ms 2024-04-17T15:06:12.662 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2666 0.29 MB/sec execute 589 sec latency 3014.593 ms 2024-04-17T15:06:13.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2670 0.29 MB/sec execute 590 sec latency 3497.812 ms 2024-04-17T15:06:14.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2682 0.29 MB/sec execute 591 sec latency 2853.894 ms 2024-04-17T15:06:15.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2693 0.30 MB/sec execute 592 sec latency 2176.180 ms 2024-04-17T15:06:16.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2712 0.30 MB/sec execute 593 sec latency 2437.353 ms 2024-04-17T15:06:17.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2724 0.31 MB/sec execute 594 sec latency 1878.162 ms 2024-04-17T15:06:18.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2729 0.31 MB/sec execute 595 sec latency 2727.517 ms 2024-04-17T15:06:19.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2740 0.31 MB/sec execute 596 sec latency 2450.770 ms 2024-04-17T15:06:20.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2745 0.31 MB/sec execute 597 sec latency 2259.507 ms 2024-04-17T15:06:21.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2760 0.31 MB/sec execute 598 sec latency 3032.527 ms 2024-04-17T15:06:22.663 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2768 0.31 MB/sec execute 599 sec latency 2311.316 ms 2024-04-17T15:06:23.664 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 600 sec 2024-04-17T15:06:24.664 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 601 sec 2024-04-17T15:06:25.664 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 602 sec 2024-04-17T15:06:26.664 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 603 sec 2024-04-17T15:06:27.664 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 604 sec 2024-04-17T15:06:28.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 605 sec 2024-04-17T15:06:29.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 606 sec 2024-04-17T15:06:30.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 607 sec 2024-04-17T15:06:31.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 608 sec 2024-04-17T15:06:32.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 609 sec 2024-04-17T15:06:33.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 610 sec 2024-04-17T15:06:34.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 611 sec 2024-04-17T15:06:35.354 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:06:35.358 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:06:35.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 612 sec 2024-04-17T15:06:36.665 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 613 sec 2024-04-17T15:06:37.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 614 sec 2024-04-17T15:06:38.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 615 sec 2024-04-17T15:06:39.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 616 sec 2024-04-17T15:06:40.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 617 sec 2024-04-17T15:06:41.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 618 sec 2024-04-17T15:06:42.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 619 sec 2024-04-17T15:06:43.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 620 sec 2024-04-17T15:06:44.666 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 621 sec 2024-04-17T15:06:45.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 622 sec 2024-04-17T15:06:46.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 623 sec 2024-04-17T15:06:47.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 624 sec 2024-04-17T15:06:48.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 625 sec 2024-04-17T15:06:49.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 626 sec 2024-04-17T15:06:50.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 627 sec 2024-04-17T15:06:51.667 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 628 sec 2024-04-17T15:06:52.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 629 sec 2024-04-17T15:06:53.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 630 sec 2024-04-17T15:06:54.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 631 sec 2024-04-17T15:06:55.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 632 sec 2024-04-17T15:06:56.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 633 sec 2024-04-17T15:06:57.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 634 sec 2024-04-17T15:06:58.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 635 sec 2024-04-17T15:06:59.668 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 636 sec 2024-04-17T15:07:00.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 637 sec 2024-04-17T15:07:01.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 638 sec 2024-04-17T15:07:02.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 639 sec 2024-04-17T15:07:03.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 640 sec 2024-04-17T15:07:04.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 641 sec 2024-04-17T15:07:05.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:07:05.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:07:05.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 642 sec 2024-04-17T15:07:06.669 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 643 sec 2024-04-17T15:07:07.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 644 sec 2024-04-17T15:07:08.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 645 sec 2024-04-17T15:07:09.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 646 sec 2024-04-17T15:07:10.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 647 sec 2024-04-17T15:07:11.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 648 sec 2024-04-17T15:07:12.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 649 sec 2024-04-17T15:07:13.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 650 sec 2024-04-17T15:07:14.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 651 sec 2024-04-17T15:07:15.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 652 sec 2024-04-17T15:07:16.670 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 653 sec 2024-04-17T15:07:17.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 654 sec 2024-04-17T15:07:18.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 655 sec 2024-04-17T15:07:19.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 656 sec 2024-04-17T15:07:20.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 657 sec 2024-04-17T15:07:21.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 658 sec 2024-04-17T15:07:22.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 659 sec 2024-04-17T15:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 660 sec 2024-04-17T15:07:24.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 661 sec 2024-04-17T15:07:25.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 662 sec 2024-04-17T15:07:26.175 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:28:50.541 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.181 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:28:50.548 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.209 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:28:50.514 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.218 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:28:50.534 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.220 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:28:50.526 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.228 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:28:50.544 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.254 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:28:50.621 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.357 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:28:50.662 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.383 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:28:50.699 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:07:26.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 663 sec 2024-04-17T15:07:27.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 664 sec 2024-04-17T15:07:28.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 665 sec 2024-04-17T15:07:29.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 666 sec 2024-04-17T15:07:30.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 667 sec 2024-04-17T15:07:31.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 668 sec 2024-04-17T15:07:32.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 669 sec 2024-04-17T15:07:33.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 670 sec 2024-04-17T15:07:34.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 671 sec 2024-04-17T15:07:35.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:07:35.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:07:35.672 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 672 sec 2024-04-17T15:07:36.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 673 sec 2024-04-17T15:07:37.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 674 sec 2024-04-17T15:07:38.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 675 sec 2024-04-17T15:07:39.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 676 sec 2024-04-17T15:07:40.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 677 sec 2024-04-17T15:07:41.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 678 sec 2024-04-17T15:07:42.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 679 sec 2024-04-17T15:07:43.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 680 sec 2024-04-17T15:07:44.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 681 sec 2024-04-17T15:07:45.673 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 682 sec 2024-04-17T15:07:46.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 683 sec 2024-04-17T15:07:47.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 684 sec 2024-04-17T15:07:48.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 685 sec 2024-04-17T15:07:49.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 686 sec 2024-04-17T15:07:50.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 687 sec 2024-04-17T15:07:51.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 688 sec 2024-04-17T15:07:52.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 689 sec 2024-04-17T15:07:53.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 690 sec 2024-04-17T15:07:54.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 691 sec 2024-04-17T15:07:55.674 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 692 sec 2024-04-17T15:07:56.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 693 sec 2024-04-17T15:07:57.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 694 sec 2024-04-17T15:07:58.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 695 sec 2024-04-17T15:07:59.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 696 sec 2024-04-17T15:08:00.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 697 sec 2024-04-17T15:08:01.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 698 sec 2024-04-17T15:08:02.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 699 sec 2024-04-17T15:08:03.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 700 sec 2024-04-17T15:08:04.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 701 sec 2024-04-17T15:08:05.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:08:05.525 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:08:05.675 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 702 sec 2024-04-17T15:08:06.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 703 sec 2024-04-17T15:08:07.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 704 sec 2024-04-17T15:08:08.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 705 sec 2024-04-17T15:08:09.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 706 sec 2024-04-17T15:08:10.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 707 sec 2024-04-17T15:08:11.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 708 sec 2024-04-17T15:08:12.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 709 sec 2024-04-17T15:08:13.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 710 sec 2024-04-17T15:08:14.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 711 sec 2024-04-17T15:08:15.676 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 712 sec 2024-04-17T15:08:16.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 713 sec 2024-04-17T15:08:17.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 714 sec 2024-04-17T15:08:18.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 715 sec 2024-04-17T15:08:19.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 716 sec 2024-04-17T15:08:20.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 717 sec 2024-04-17T15:08:21.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 718 sec 2024-04-17T15:08:22.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 719 sec 2024-04-17T15:08:23.677 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 720 sec 2024-04-17T15:08:24.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 721 sec 2024-04-17T15:08:25.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 722 sec 2024-04-17T15:08:26.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 723 sec 2024-04-17T15:08:27.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 724 sec 2024-04-17T15:08:28.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 725 sec 2024-04-17T15:08:29.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 726 sec 2024-04-17T15:08:30.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 727 sec 2024-04-17T15:08:31.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 728 sec 2024-04-17T15:08:32.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 729 sec 2024-04-17T15:08:33.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 730 sec 2024-04-17T15:08:34.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 731 sec 2024-04-17T15:08:35.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:08:35.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:08:35.678 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 732 sec 2024-04-17T15:08:36.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 733 sec 2024-04-17T15:08:37.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 734 sec 2024-04-17T15:08:38.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 735 sec 2024-04-17T15:08:39.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 736 sec 2024-04-17T15:08:40.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 737 sec 2024-04-17T15:08:41.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 738 sec 2024-04-17T15:08:42.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 739 sec 2024-04-17T15:08:43.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 740 sec 2024-04-17T15:08:44.679 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 741 sec 2024-04-17T15:08:45.680 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 742 sec 2024-04-17T15:08:46.680 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 743 sec 2024-04-17T15:08:47.680 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 744 sec 2024-04-17T15:08:48.680 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 745 sec 2024-04-17T15:08:49.680 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 746 sec 2024-04-17T15:08:50.680 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 747 sec 2024-04-17T15:08:51.680 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 748 sec 2024-04-17T15:08:52.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 749 sec 2024-04-17T15:08:53.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 750 sec 2024-04-17T15:08:54.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 751 sec 2024-04-17T15:08:55.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 752 sec 2024-04-17T15:08:56.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 753 sec 2024-04-17T15:08:57.681 INFO:tasks.workunit.client.0.smithi016.stdout: 9 cleanup 754 sec 2024-04-17T15:08:58.681 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 755 sec 2024-04-17T15:08:59.681 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 756 sec 2024-04-17T15:09:00.681 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 757 sec 2024-04-17T15:09:01.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 758 sec 2024-04-17T15:09:02.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 759 sec 2024-04-17T15:09:03.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 760 sec 2024-04-17T15:09:04.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 761 sec 2024-04-17T15:09:05.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:09:05.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:09:05.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 762 sec 2024-04-17T15:09:06.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 763 sec 2024-04-17T15:09:07.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 764 sec 2024-04-17T15:09:08.682 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 765 sec 2024-04-17T15:09:09.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 766 sec 2024-04-17T15:09:10.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 767 sec 2024-04-17T15:09:11.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 768 sec 2024-04-17T15:09:12.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 769 sec 2024-04-17T15:09:13.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 770 sec 2024-04-17T15:09:14.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 771 sec 2024-04-17T15:09:15.683 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 772 sec 2024-04-17T15:09:16.685 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 773 sec 2024-04-17T15:09:17.684 INFO:tasks.workunit.client.0.smithi016.stdout: 7 cleanup 774 sec 2024-04-17T15:09:18.684 INFO:tasks.workunit.client.0.smithi016.stdout: 6 cleanup 775 sec 2024-04-17T15:09:19.684 INFO:tasks.workunit.client.0.smithi016.stdout: 6 cleanup 776 sec 2024-04-17T15:09:20.684 INFO:tasks.workunit.client.0.smithi016.stdout: 6 cleanup 777 sec 2024-04-17T15:09:21.684 INFO:tasks.workunit.client.0.smithi016.stdout: 5 cleanup 778 sec 2024-04-17T15:09:22.684 INFO:tasks.workunit.client.0.smithi016.stdout: 2 cleanup 779 sec 2024-04-17T15:09:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: 2 cleanup 780 sec 2024-04-17T15:09:24.685 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 781 sec 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: 0 cleanup 781 sec 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: Operation Count AvgLat MaxLat 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: NTCreateX 3894 660.452 9707.807 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: Close 3337 0.007 0.224 2024-04-17T15:09:25.043 INFO:tasks.workunit.client.0.smithi016.stdout: Rename 173 2807.944 7856.994 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Unlink 409 1545.307 9801.969 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Qpathinfo 3572 457.099 7504.431 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Qfileinfo 1050 0.002 0.050 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Qfsinfo 511 12.689 224.641 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Sfileinfo 499 315.945 12221.340 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Find 1251 11.148 3351.562 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: WriteX 3662 31.246 5440.689 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: ReadX 5403 20.872 4794.317 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: LockX 7 1180.255 1944.841 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: UnlockX 7 777.015 1667.717 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: Flush 344 823.068 4967.226 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-17T15:09:25.044 INFO:tasks.workunit.client.0.smithi016.stdout:Throughput 0.312553 MB/sec 10 clients 10 procs max_latency=12221.351 ms 2024-04-17T15:09:25.045 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T15:09:25.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T15:09:35.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:09:35.703 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:10:03.411 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-17T15:10:03.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T15:10:04.360 DEBUG:teuthology.parallel:result is None 2024-04-17T15:10:04.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T15:10:04.639 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T15:10:04.639 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-17T15:10:04.649 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-17T15:10:04.649 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T15:10:04.649 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T15:10:04.658 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-17T15:10:04.658 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T15:10:04.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:10:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 Processor -- start 2024-04-17T15:10:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 -- start start 2024-04-17T15:10:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc151db0 0x7fb9fc0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc158610 con 0x7fb9fc15be40 2024-04-17T15:10:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc0c8be0 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fba00e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc071b30 con 0x7fb9fc151db0 2024-04-17T15:10:04.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fb9fa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:04.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fb9fa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33602/0 (socket says 172.21.15.16:33602) 2024-04-17T15:10:04.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.899+0000 7fb9fa800640 1 -- 172.21.15.16:0/1208160490 learned_addr learned my addr 172.21.15.16:0/1208160490 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:04.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.903+0000 7fb9fa800640 1 -- 172.21.15.16:0/1208160490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc151db0 msgr2=0x7fb9fc0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:04.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.903+0000 7fb9fa800640 1 --2- 172.21.15.16:0/1208160490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc151db0 0x7fb9fc0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.903+0000 7fb9fa800640 1 -- 172.21.15.16:0/1208160490 >> v1:172.21.15.67:6789/0 conn(0x7fb9fc15be40 legacy=0x7fb9fc157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:04.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.903+0000 7fb9fa800640 1 -- 172.21.15.16:0/1208160490 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1588f0 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.907+0000 7fb9fa800640 1 --2- 172.21.15.16:0/1208160490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009e80 tx=0x7fb9f401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43308f014572196 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:04.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fb9f9400640 1 -- 172.21.15.16:0/1208160490 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40b4070 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fb9f9400640 1 -- 172.21.15.16:0/1208160490 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f40af400 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fb9f9400640 1 -- 172.21.15.16:0/1208160490 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40af7d0 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 -- 172.21.15.16:0/1208160490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc0c5a20 msgr2=0x7fb9fc0c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 --2- 172.21.15.16:0/1208160490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009e80 tx=0x7fb9f401f1c0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 -- 172.21.15.16:0/1208160490 shutdown_connections 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 --2- 172.21.15.16:0/1208160490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc0c5a20 0x7fb9fc0c3970 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 --2- 172.21.15.16:0/1208160490 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc151db0 0x7fb9fc0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 -- 172.21.15.16:0/1208160490 >> 172.21.15.16:0/1208160490 conn(0x7fb9fc06ba30 msgr2=0x7fb9fc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 -- 172.21.15.16:0/1208160490 shutdown_connections 2024-04-17T15:10:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.911+0000 7fba00e00640 1 -- 172.21.15.16:0/1208160490 wait complete. 2024-04-17T15:10:04.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 Processor -- start 2024-04-17T15:10:04.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 -- start start 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc0c5a20 0x7fb9fc156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9fc15be40 0x7fb9fc157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc15b920 con 0x7fb9fc151db0 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc15b640 con 0x7fb9fc15be40 2024-04-17T15:10:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fba00e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc1582e0 con 0x7fb9fc0c5a20 2024-04-17T15:10:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33604/0 (socket says 172.21.15.16:33604) 2024-04-17T15:10:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.915+0000 7fb9f1400640 1 -- 172.21.15.16:0/2191554244 learned_addr learned my addr 172.21.15.16:0/2191554244 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.919+0000 7fb9f1400640 1 -- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc0c5a20 msgr2=0x7fb9fc156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.919+0000 7fb9f1400640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc0c5a20 0x7fb9fc156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.919+0000 7fb9f1400640 1 -- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9fc15be40 msgr2=0x7fb9fc157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.919+0000 7fb9f1400640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9fc15be40 0x7fb9fc157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:04.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.919+0000 7fb9f1400640 1 -- 172.21.15.16:0/2191554244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc072280 con 0x7fb9fc151db0 2024-04-17T15:10:04.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.923+0000 7fb9f1400640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b410 tx=0x7fb9e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:04.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4015020 con 0x7fb9fc151db0 2024-04-17T15:10:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e4011830 con 0x7fb9fc151db0 2024-04-17T15:10:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011c20 con 0x7fb9fc151db0 2024-04-17T15:10:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc1567b0 con 0x7fb9fc151db0 2024-04-17T15:10:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc146f20 con 0x7fb9fc151db0 2024-04-17T15:10:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.927+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc076280 con 0x7fb9fc151db0 2024-04-17T15:10:04.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.947+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb9e4018020 con 0x7fb9fc151db0 2024-04-17T15:10:04.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.947+0000 7fb9f2a00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 0x7fb9d806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:04.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.947+0000 7fb9f9e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 0x7fb9d806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:04.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:04.951+0000 7fb9f9e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 0x7fb9d806a8c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009730 tx=0x7fb9ec006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.211+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb9e4022e70 con 0x7fb9fc151db0 2024-04-17T15:10:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.211+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb9e401f070 con 0x7fb9fc151db0 2024-04-17T15:10:05.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.375+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9fc14f090 con 0x7fb9fc151db0 2024-04-17T15:10:05.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.415+0000 7fb9f2a00640 1 -- 172.21.15.16:0/2191554244 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7fb9e40570b0 con 0x7fb9fc151db0 2024-04-17T15:10:05.418 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:05.418 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 msgr2=0x7fb9d806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 0x7fb9d806a8c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009730 tx=0x7fb9ec006ca0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 msgr2=0x7fb9fc1427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b410 tx=0x7fb9e400b8d0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 shutdown_connections 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fb9d8068400 0x7fb9d806a8c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9fc15be40 0x7fb9fc157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc151db0 0x7fb9fc1427c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 --2- 172.21.15.16:0/2191554244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9fc0c5a20 0x7fb9fc156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 >> 172.21.15.16:0/2191554244 conn(0x7fb9fc06ba30 msgr2=0x7fb9fc06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 shutdown_connections 2024-04-17T15:10:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.419+0000 7fba00e00640 1 -- 172.21.15.16:0/2191554244 wait complete. 2024-04-17T15:10:05.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T14:39:17.815818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T14:39:56.221860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T14:39:57.848198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T15:10:05.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T15:10:05.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.583+0000 7fe088400640 1 Processor -- start 2024-04-17T15:10:05.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.583+0000 7fe088400640 1 -- start start 2024-04-17T15:10:05.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe088400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe080155080 0x7fe08015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe088400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe08015ec50 0x7fe0800ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe088400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0800c8d40 con 0x7fe08015f070 2024-04-17T15:10:05.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe088400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe08015b400 con 0x7fe08015ec50 2024-04-17T15:10:05.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe088400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fe08015b6e0 con 0x7fe080155080 2024-04-17T15:10:05.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe085000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe08015ec50 0x7fe0800ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe085000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe08015ec50 0x7fe0800ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33616/0 (socket says 172.21.15.16:33616) 2024-04-17T15:10:05.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe085000640 1 -- 172.21.15.16:0/1119660390 learned_addr learned my addr 172.21.15.16:0/1119660390 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:05.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.587+0000 7fe085a00640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe080155080 0x7fe08015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.591+0000 7fe085000640 1 -- 172.21.15.16:0/1119660390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe080155080 msgr2=0x7fe08015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:05.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.591+0000 7fe085000640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe080155080 0x7fe08015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.591+0000 7fe085000640 1 -- 172.21.15.16:0/1119660390 >> v1:172.21.15.16:6789/0 conn(0x7fe08015f070 legacy=0x7fe0800c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.591+0000 7fe085000640 1 -- 172.21.15.16:0/1119660390 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08015b9c0 con 0x7fe08015ec50 2024-04-17T15:10:05.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.595+0000 7fe085000640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe0800ca9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009870 tx=0x7fe06c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163ce812985ce54f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:05.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe07fe00640 1 -- 172.21.15.16:0/1119660390 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0b5070 con 0x7fe08015ec50 2024-04-17T15:10:05.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe07fe00640 1 -- 172.21.15.16:0/1119660390 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c0a8a50 con 0x7fe08015ec50 2024-04-17T15:10:05.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe07fe00640 1 -- 172.21.15.16:0/1119660390 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0a8e20 con 0x7fe08015ec50 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- 172.21.15.16:0/1119660390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 msgr2=0x7fe0800ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe0800ca9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009870 tx=0x7fe06c01ed50 comp rx=0 tx=0).stop 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- 172.21.15.16:0/1119660390 shutdown_connections 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe0800ca9f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 --2- 172.21.15.16:0/1119660390 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe080155080 0x7fe08015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- 172.21.15.16:0/1119660390 >> 172.21.15.16:0/1119660390 conn(0x7fe08006fd20 msgr2=0x7fe080070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- 172.21.15.16:0/1119660390 shutdown_connections 2024-04-17T15:10:05.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- 172.21.15.16:0/1119660390 wait complete. 2024-04-17T15:10:05.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 Processor -- start 2024-04-17T15:10:05.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.599+0000 7fe088400640 1 -- start start 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe080155080 0x7fe08015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe08015f070 0x7fe080149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe080155460 con 0x7fe08015ec50 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe08015e730 con 0x7fe080155080 2024-04-17T15:10:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe088400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fe0800cb7e0 con 0x7fe08015f070 2024-04-17T15:10:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe085000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe085000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33618/0 (socket says 172.21.15.16:33618) 2024-04-17T15:10:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe085000640 1 -- 172.21.15.16:0/480512169 learned_addr learned my addr 172.21.15.16:0/480512169 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe086400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe08015f070 0x7fe080149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.603+0000 7fe085a00640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe080155080 0x7fe08015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 -- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe08015f070 msgr2=0x7fe080149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe08015f070 0x7fe080149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 -- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe080155080 msgr2=0x7fe08015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe080155080 0x7fe08015d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 -- 172.21.15.16:0/480512169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0801548e0 con 0x7fe08015ec50 2024-04-17T15:10:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.607+0000 7fe085000640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0b3040 tx=0x7fe06c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.611+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0b5070 con 0x7fe08015ec50 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.611+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c0b0de0 con 0x7fe08015ec50 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.611+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0bb670 con 0x7fe08015ec50 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.611+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0800c36c0 con 0x7fe08015ec50 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.611+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08014f580 con 0x7fe08015ec50 2024-04-17T15:10:05.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.615+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe080076280 con 0x7fe08015ec50 2024-04-17T15:10:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.635+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe06c0c2060 con 0x7fe08015ec50 2024-04-17T15:10:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.635+0000 7fe07d600640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 0x7fe06006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.635+0000 7fe085a00640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 0x7fe06006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:05.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.635+0000 7fe085a00640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 0x7fe06006a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe074009b60 tx=0x7fe074009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:05.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.639+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe06c0f1ee0 con 0x7fe08015ec50 2024-04-17T15:10:05.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:10:05.766 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:10:05.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:05.899+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe06c0188b0 con 0x7fe08015ec50 2024-04-17T15:10:06.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.067+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe0800cb5c0 con 0x7fe08015ec50 2024-04-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.127+0000 7fe07d600640 1 -- 172.21.15.16:0/480512169 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe06c0f3e40 con 0x7fe08015ec50 2024-04-17T15:10:06.129 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 msgr2=0x7fe06006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 0x7fe06006a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe074009b60 tx=0x7fe074009190 comp rx=0 tx=0).stop 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 msgr2=0x7fe08014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0b3040 tx=0x7fe06c01baf0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 shutdown_connections 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fe060068400 0x7fe06006a8c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe08015f070 0x7fe080149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe08015ec50 0x7fe08014fd80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 --2- 172.21.15.16:0/480512169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe080155080 0x7fe08015d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 >> 172.21.15.16:0/480512169 conn(0x7fe08006fd20 msgr2=0x7fe0800c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 shutdown_connections 2024-04-17T15:10:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.131+0000 7fe088400640 1 -- 172.21.15.16:0/480512169 wait complete. 2024-04-17T15:10:06.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T15:10:06.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 Processor -- start 2024-04-17T15:10:06.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 -- start start 2024-04-17T15:10:06.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3de80c3060 0x7f3de80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de80c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de8153430 con 0x7f3de8153050 2024-04-17T15:10:06.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3de806ef10 con 0x7f3de80c3060 2024-04-17T15:10:06.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3df0600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f3de806ff20 con 0x7f3de80c8d20 2024-04-17T15:10:06.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3ded200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3de80c3060 0x7f3de80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3dee600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de80c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3dee600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de80c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:44754/0 (socket says 172.21.15.16:44754) 2024-04-17T15:10:06.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.299+0000 7f3dee600640 1 -- 172.21.15.16:0/1883048820 learned_addr learned my addr 172.21.15.16:0/1883048820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:06.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.307+0000 7f3ded200640 1 -- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 msgr2=0x7f3de80c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:06.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.307+0000 7f3ded200640 1 --2- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de80c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.307+0000 7f3ded200640 1 -- 172.21.15.16:0/1883048820 >> v1:172.21.15.67:6789/0 conn(0x7f3de8153050 legacy=0x7f3de8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:06.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.307+0000 7f3ded200640 1 -- 172.21.15.16:0/1883048820 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de80c3ed0 con 0x7f3de80c3060 2024-04-17T15:10:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.315+0000 7f3ded200640 1 --2- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de80c87e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097c0 tx=0x7f3dd401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f8e3e1d88eda71 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.327+0000 7f3de7e00640 1 -- 172.21.15.16:0/1883048820 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40b5070 con 0x7f3de80c3060 2024-04-17T15:10:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3de7e00640 1 -- 172.21.15.16:0/1883048820 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd40a8910 con 0x7f3de80c3060 2024-04-17T15:10:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3de7e00640 1 -- 172.21.15.16:0/1883048820 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40a8ce0 con 0x7f3de80c3060 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 msgr2=0x7f3de80c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de80c87e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097c0 tx=0x7f3dd401ec50 comp rx=0 tx=0).stop 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- 172.21.15.16:0/1883048820 shutdown_connections 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de80c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- 172.21.15.16:0/1883048820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de80c87e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- 172.21.15.16:0/1883048820 >> 172.21.15.16:0/1883048820 conn(0x7f3de806ba30 msgr2=0x7f3de806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- 172.21.15.16:0/1883048820 shutdown_connections 2024-04-17T15:10:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- 172.21.15.16:0/1883048820 wait complete. 2024-04-17T15:10:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 Processor -- start 2024-04-17T15:10:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- start start 2024-04-17T15:10:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de81f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de8072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3de806f720 con 0x7f3de8153050 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3de806f440 con 0x7f3de80c3060 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.331+0000 7f3df0600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f3de806fa00 con 0x7f3de80c8d20 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.335+0000 7f3dee600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.335+0000 7f3dee600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33630/0 (socket says 172.21.15.16:33630) 2024-04-17T15:10:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.335+0000 7f3dee600640 1 -- 172.21.15.16:0/893294637 learned_addr learned my addr 172.21.15.16:0/893294637 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.335+0000 7f3ded200640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de8072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.335+0000 7f3dedc00640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de81f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dee600640 1 -- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 msgr2=0x7f3de8072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dee600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de8072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dee600640 1 -- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 msgr2=0x7f3de81f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dee600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de81f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dee600640 1 -- 172.21.15.16:0/893294637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de81e5050 con 0x7f3de8153050 2024-04-17T15:10:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.339+0000 7f3dedc00640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de81f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T15:10:06.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.343+0000 7f3dee600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009d60 tx=0x7f3de000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:06.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de000cd20 con 0x7f3de8153050 2024-04-17T15:10:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de00039a0 con 0x7f3de8153050 2024-04-17T15:10:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0003d90 con 0x7f3de8153050 2024-04-17T15:10:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de81583c0 con 0x7f3de8153050 2024-04-17T15:10:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de81df010 con 0x7f3de8153050 2024-04-17T15:10:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.347+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de8076280 con 0x7f3de8153050 2024-04-17T15:10:06.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.367+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3de0012050 con 0x7f3de8153050 2024-04-17T15:10:06.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.367+0000 7f3de5600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 0x7f3dc806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.367+0000 7f3dedc00640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 0x7f3dc806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.371+0000 7f3dedc00640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 0x7f3dc806a8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009890 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:06.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.371+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3de0055b20 con 0x7f3de8153050 2024-04-17T15:10:06.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.631+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3de0022020 con 0x7f3de8153050 2024-04-17T15:10:06.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.795+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3de80c5ce0 con 0x7f3de8153050 2024-04-17T15:10:06.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.803+0000 7f3de5600640 1 -- 172.21.15.16:0/893294637 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f3de81e5050 con 0x7f3de8153050 2024-04-17T15:10:06.804 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 msgr2=0x7f3dc806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 0x7f3dc806a8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009890 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 msgr2=0x7f3de8148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009d60 tx=0x7f3de000c490 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 shutdown_connections 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3dc8068400 0x7f3dc806a8c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de8153050 0x7f3de8148d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3de80c8d20 0x7f3de8072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 --2- 172.21.15.16:0/893294637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3de80c3060 0x7f3de81f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 >> 172.21.15.16:0/893294637 conn(0x7f3de806ba30 msgr2=0x7f3de814dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 shutdown_connections 2024-04-17T15:10:06.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.807+0000 7f3df0600640 1 -- 172.21.15.16:0/893294637 wait complete. 2024-04-17T15:10:06.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T15:10:06.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 Processor -- start 2024-04-17T15:10:06.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 -- start start 2024-04-17T15:10:06.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbafc155200 0x7fbafc15b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbafc0cbd70 0x7fbafc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:06.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbafc0cc930 con 0x7fbafc0cb720 2024-04-17T15:10:06.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc0caae0 con 0x7fbafc0cbd70 2024-04-17T15:10:06.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.975+0000 7fbb02400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc0cadc0 con 0x7fbafc155200 2024-04-17T15:10:06.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.979+0000 7fbafb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbafc155200 0x7fbafc15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:06.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.983+0000 7fbafb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbafc155200 0x7fbafc15b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:35650/0 (socket says 172.21.15.16:35650) 2024-04-17T15:10:06.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.983+0000 7fbafb400640 1 -- 172.21.15.16:0/1908079125 learned_addr learned my addr 172.21.15.16:0/1908079125 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.987+0000 7fbafb400640 1 -- 172.21.15.16:0/1908079125 >> v2:172.21.15.16:3300/0 conn(0x7fbafc0cbd70 msgr2=0x7fbafc0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.987+0000 7fbafb400640 1 --2- 172.21.15.16:0/1908079125 >> v2:172.21.15.16:3300/0 conn(0x7fbafc0cbd70 0x7fbafc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.987+0000 7fbafb400640 1 -- 172.21.15.16:0/1908079125 >> v1:172.21.15.16:6789/0 conn(0x7fbafc0cb720 legacy=0x7fbafc15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:06.987+0000 7fbafb400640 1 -- 172.21.15.16:0/1908079125 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc0cc370 con 0x7fbafc155200 2024-04-17T15:10:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.099+0000 7fbafb400640 1 --2- 172.21.15.16:0/1908079125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc155200 0x7fbafc15b820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0c71a0 tx=0x7fbaec01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7d8daa83c968a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:07.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.111+0000 7fbafa000640 1 -- 172.21.15.16:0/1908079125 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0b0070 con 0x7fbafc155200 2024-04-17T15:10:07.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.111+0000 7fbafa000640 1 -- 172.21.15.16:0/1908079125 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec0ab600 con 0x7fbafc155200 2024-04-17T15:10:07.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.111+0000 7fbafa000640 1 -- 172.21.15.16:0/1908079125 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0ab9d0 con 0x7fbafc155200 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- 172.21.15.16:0/1908079125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc155200 msgr2=0x7fbafc15b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- 172.21.15.16:0/1908079125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc155200 0x7fbafc15b820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0c71a0 tx=0x7fbaec01c450 comp rx=0 tx=0).stop 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- 172.21.15.16:0/1908079125 shutdown_connections 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- 172.21.15.16:0/1908079125 >> v2:172.21.15.16:3300/0 conn(0x7fbafc0cbd70 0x7fbafc0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- 172.21.15.16:0/1908079125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc155200 0x7fbafc15b820 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- 172.21.15.16:0/1908079125 >> 172.21.15.16:0/1908079125 conn(0x7fbafc06ba30 msgr2=0x7fbafc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- 172.21.15.16:0/1908079125 shutdown_connections 2024-04-17T15:10:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- 172.21.15.16:0/1908079125 wait complete. 2024-04-17T15:10:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 Processor -- start 2024-04-17T15:10:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- start start 2024-04-17T15:10:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0cb720 0x7fbafc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbafc0cbd70 0x7fbafc1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1682b0 con 0x7fbafc155200 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc168130 con 0x7fbafc0cb720 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbb02400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc168430 con 0x7fbafc0cbd70 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.115+0000 7fbafbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.119+0000 7fbafbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33646/0 (socket says 172.21.15.16:33646) 2024-04-17T15:10:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.119+0000 7fbafbe00640 1 -- 172.21.15.16:0/3618858379 learned_addr learned my addr 172.21.15.16:0/3618858379 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.119+0000 7fbafaa00640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbafc0cbd70 0x7fbafc1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.119+0000 7fbafb400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0cb720 0x7fbafc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 -- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbafc0cbd70 msgr2=0x7fbafc1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbafc0cbd70 0x7fbafc1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 -- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0cb720 msgr2=0x7fbafc14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0cb720 0x7fbafc14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 -- 172.21.15.16:0/3618858379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1f8f10 con 0x7fbafc155200 2024-04-17T15:10:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.123+0000 7fbafbe00640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c7b0 tx=0x7fbaf400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4017070 con 0x7fbafc155200 2024-04-17T15:10:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4003db0 con 0x7fbafc155200 2024-04-17T15:10:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40052b0 con 0x7fbafc155200 2024-04-17T15:10:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1f8c30 con 0x7fbafc155200 2024-04-17T15:10:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1f4c20 con 0x7fbafc155200 2024-04-17T15:10:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.127+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc076280 con 0x7fbafc155200 2024-04-17T15:10:07.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.151+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbaf401a070 con 0x7fbafc155200 2024-04-17T15:10:07.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.151+0000 7fbaf3400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 0x7fbadc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.151+0000 7fbafb400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 0x7fbadc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.151+0000 7fbafb400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 0x7fbadc06a890 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0ad000 tx=0x7fbaec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.415+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fbaf4054410 con 0x7fbafc155200 2024-04-17T15:10:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.415+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbaf4021020 con 0x7fbafc155200 2024-04-17T15:10:07.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.583+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbafc075c30 con 0x7fbafc155200 2024-04-17T15:10:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.587+0000 7fbaf3400640 1 -- 172.21.15.16:0/3618858379 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fbaf4056370 con 0x7fbafc155200 2024-04-17T15:10:07.589 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-17T15:10:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 msgr2=0x7fbadc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 0x7fbadc06a890 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0ad000 tx=0x7fbaec0a6000 comp rx=0 tx=0).stop 2024-04-17T15:10:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 msgr2=0x7fbafc144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c7b0 tx=0x7fbaf400cc70 comp rx=0 tx=0).stop 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 shutdown_connections 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fbadc0683d0 0x7fbadc06a890 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbafc155200 0x7fbafc144700 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbafc0cbd70 0x7fbafc1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 --2- 172.21.15.16:0/3618858379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0cb720 0x7fbafc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 >> 172.21.15.16:0/3618858379 conn(0x7fbafc06ba30 msgr2=0x7fbafc072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 shutdown_connections 2024-04-17T15:10:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.591+0000 7fbb02400640 1 -- 172.21.15.16:0/3618858379 wait complete. 2024-04-17T15:10:07.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T15:10:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 Processor -- start 2024-04-17T15:10:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 -- start start 2024-04-17T15:10:07.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 0x7f81f80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f8153430 con 0x7f81f80c8d20 2024-04-17T15:10:07.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f80c3ed0 con 0x7f81f8153050 2024-04-17T15:10:07.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81fcc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f81f806ef10 con 0x7f81f80c3060 2024-04-17T15:10:07.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81f6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f81f80c8d20 0x7f81f80c7190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52578/0 (socket says 172.21.15.16:52578) 2024-04-17T15:10:07.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81f6800640 1 -- 172.21.15.16:0/2419530673 learned_addr learned my addr 172.21.15.16:0/2419530673 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.755+0000 7f81f5400640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 0x7f81f80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.759+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091408729 0 0) 0x7f81f8153430 con 0x7f81f80c8d20 2024-04-17T15:10:07.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.759+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81dc003530 con 0x7f81f80c8d20 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 403101824 0 0) 0x7f81dc003530 con 0x7f81f80c8d20 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 msgr2=0x7f81f80c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 0x7f81f80c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 >> v1:172.21.15.67:6789/0 conn(0x7f81f8153050 legacy=0x7f81f8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f806f160 con 0x7f81f80c8d20 2024-04-17T15:10:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f81f0001a00 con 0x7f81f80c8d20 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 >> v1:172.21.15.16:6789/0 conn(0x7f81f80c8d20 legacy=0x7f81f80c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc0039f0 0x7f81dc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81dc004810 0x7f81dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 0x7f81dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81f806ef10 con 0x7f81dc004810 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc00bb60 con 0x7f81dc0039f0 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.763+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f81dc00bd60 con 0x7f81f80c3060 2024-04-17T15:10:07.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81dc004810 0x7f81dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 -- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 msgr2=0x7f81dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c3060 0x7f81dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 -- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc0039f0 msgr2=0x7f81dc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc0039f0 0x7f81dc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.767+0000 7f81f5400640 1 -- 172.21.15.16:0/2419530673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc003530 con 0x7f81dc004810 2024-04-17T15:10:07.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.771+0000 7f81f5400640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81dc004810 0x7f81dc004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009ae0 tx=0x7f81e401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e816fb48d93e7ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.775+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40b2070 con 0x7f81dc004810 2024-04-17T15:10:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.775+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e40a55c0 con 0x7f81dc004810 2024-04-17T15:10:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.775+0000 7f81f4a00640 1 -- 172.21.15.16:0/2419530673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40096b0 con 0x7f81dc004810 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.775+0000 7f81fcc00640 1 -- 172.21.15.16:0/2419530673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81dc004810 msgr2=0x7f81dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.775+0000 7f81fcc00640 1 --2- 172.21.15.16:0/2419530673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81dc004810 0x7f81dc004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009ae0 tx=0x7f81e401cab0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81f6800640 1 -- 172.21.15.16:0/2419530673 reap_dead start 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- 172.21.15.16:0/2419530673 shutdown_connections 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- 172.21.15.16:0/2419530673 >> 172.21.15.16:0/2419530673 conn(0x7f81f806ba30 msgr2=0x7f81f806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- 172.21.15.16:0/2419530673 shutdown_connections 2024-04-17T15:10:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- 172.21.15.16:0/2419530673 wait complete. 2024-04-17T15:10:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 Processor -- start 2024-04-17T15:10:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- start start 2024-04-17T15:10:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc004810 0x7f81f8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c6f20 0x7f81f813ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81f806f720 con 0x7f81f80c7380 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81f806ff20 con 0x7f81dc004810 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81fcc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f81f806fa00 con 0x7f81f80c6f20 2024-04-17T15:10:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.779+0000 7f81f6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.783+0000 7f81f6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33668/0 (socket says 172.21.15.16:33668) 2024-04-17T15:10:07.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.783+0000 7f81f6800640 1 -- 172.21.15.16:0/1629609198 learned_addr learned my addr 172.21.15.16:0/1629609198 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:07.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.783+0000 7f81f5e00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc004810 0x7f81f8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.783+0000 7f81f5400640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c6f20 0x7f81f813ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 -- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c6f20 msgr2=0x7f81f813ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c6f20 0x7f81f813ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 -- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc004810 msgr2=0x7f81f8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc004810 0x7f81f8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 -- 172.21.15.16:0/1629609198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80c78f0 con 0x7f81f80c7380 2024-04-17T15:10:07.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.787+0000 7f81f6800640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f81f8071970 tx=0x7f81f000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000a640 con 0x7f81f80c7380 2024-04-17T15:10:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f000a7e0 con 0x7f81f80c7380 2024-04-17T15:10:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000abd0 con 0x7f81f80c7380 2024-04-17T15:10:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f81eff40 con 0x7f81f80c7380 2024-04-17T15:10:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f81f0500 con 0x7f81f80c7380 2024-04-17T15:10:07.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.791+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f8076280 con 0x7f81f80c7380 2024-04-17T15:10:07.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.811+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81f0007070 con 0x7f81f80c7380 2024-04-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.815+0000 7f81ee000640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 0x7f81d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:07.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.815+0000 7f81f5e00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 0x7f81d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:07.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:07.815+0000 7f81f5e00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 0x7f81d806a890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e8001170 tx=0x7f81e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:08.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.075+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f81f00546d0 con 0x7f81f80c7380 2024-04-17T15:10:08.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.075+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f81f0022080 con 0x7f81f80c7380 2024-04-17T15:10:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.255+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81f80c7cb0 con 0x7f81f80c7380 2024-04-17T15:10:08.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.259+0000 7f81ee000640 1 -- 172.21.15.16:0/1629609198 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f81f0056630 con 0x7f81f80c7380 2024-04-17T15:10:08.261 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 msgr2=0x7f81d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 0x7f81d806a890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e8001170 tx=0x7f81e8009040 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 msgr2=0x7f81f813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f81f8071970 tx=0x7f81f000ccd0 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 shutdown_connections 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f81d80683d0 0x7f81d806a890 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81f80c7380 0x7f81f813b160 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81f80c6f20 0x7f81f813ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1629609198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81dc004810 0x7f81f8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 >> 172.21.15.16:0/1629609198 conn(0x7f81f806ba30 msgr2=0x7f81f81519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:08.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 shutdown_connections 2024-04-17T15:10:08.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:08.263+0000 7f81fcc00640 1 -- 172.21.15.16:0/1629609198 wait complete. 2024-04-17T15:10:08.285 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-17T15:10:08.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T15:10:08.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-17T15:10:08.955 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:10:08.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T15:10:08.955 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T15:10:08.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T15:10:08.978 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-17T15:10:09.030 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T15:10:09.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T15:10:09.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T15:10:09.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T15:10:09.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-17T15:10:09.248 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T15:10:09.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T15:10:09.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:10:09.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 Processor -- start 2024-04-17T15:10:09.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 -- start start 2024-04-17T15:10:09.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff02c15be40 0x7ff02c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff02c0c5a20 0x7ff02c0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff02c158610 con 0x7ff02c151db0 2024-04-17T15:10:09.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff02c0c8be0 con 0x7ff02c15be40 2024-04-17T15:10:09.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff033200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff02c071b30 con 0x7ff02c0c5a20 2024-04-17T15:10:09.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff023400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff02c15be40 0x7ff02c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:09.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff023400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff02c15be40 0x7ff02c0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33682/0 (socket says 172.21.15.16:33682) 2024-04-17T15:10:09.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.407+0000 7ff023400640 1 -- 172.21.15.16:0/959643437 learned_addr learned my addr 172.21.15.16:0/959643437 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:09.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.411+0000 7ff023400640 1 -- 172.21.15.16:0/959643437 >> v2:172.21.15.67:3300/0 conn(0x7ff02c0c5a20 msgr2=0x7ff02c0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:09.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.411+0000 7ff023400640 1 --2- 172.21.15.16:0/959643437 >> v2:172.21.15.67:3300/0 conn(0x7ff02c0c5a20 0x7ff02c0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.411+0000 7ff023400640 1 -- 172.21.15.16:0/959643437 >> v1:172.21.15.67:6789/0 conn(0x7ff02c151db0 legacy=0x7ff02c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:09.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.411+0000 7ff023400640 1 -- 172.21.15.16:0/959643437 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c1588f0 con 0x7ff02c15be40 2024-04-17T15:10:09.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.415+0000 7ff023400640 1 --2- 172.21.15.16:0/959643437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c15be40 0x7ff02c0c86a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c5940 tx=0x7ff0140213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50bd71cc48238a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:09.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.419+0000 7ff02b400640 1 -- 172.21.15.16:0/959643437 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b6070 con 0x7ff02c15be40 2024-04-17T15:10:09.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff02b400640 1 -- 172.21.15.16:0/959643437 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0140b1600 con 0x7ff02c15be40 2024-04-17T15:10:09.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff02b400640 1 -- 172.21.15.16:0/959643437 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b19d0 con 0x7ff02c15be40 2024-04-17T15:10:09.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- 172.21.15.16:0/959643437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c15be40 msgr2=0x7ff02c0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:09.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- 172.21.15.16:0/959643437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c15be40 0x7ff02c0c86a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c5940 tx=0x7ff0140213a0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- 172.21.15.16:0/959643437 shutdown_connections 2024-04-17T15:10:09.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- 172.21.15.16:0/959643437 >> v2:172.21.15.67:3300/0 conn(0x7ff02c0c5a20 0x7ff02c0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- 172.21.15.16:0/959643437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c15be40 0x7ff02c0c86a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- 172.21.15.16:0/959643437 >> 172.21.15.16:0/959643437 conn(0x7ff02c06ba30 msgr2=0x7ff02c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:09.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- 172.21.15.16:0/959643437 shutdown_connections 2024-04-17T15:10:09.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- 172.21.15.16:0/959643437 wait complete. 2024-04-17T15:10:09.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 Processor -- start 2024-04-17T15:10:09.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- start start 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff02c151db0 0x7ff02c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff02c15be40 0x7ff02c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c15b920 con 0x7ff02c0c5a20 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c15b640 con 0x7ff02c15be40 2024-04-17T15:10:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.423+0000 7ff033200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7ff02c1582e0 con 0x7ff02c151db0 2024-04-17T15:10:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33698/0 (socket says 172.21.15.16:33698) 2024-04-17T15:10:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 -- 172.21.15.16:0/3497622650 learned_addr learned my addr 172.21.15.16:0/3497622650 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:09.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 -- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff02c151db0 msgr2=0x7ff02c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:09.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff02c151db0 0x7ff02c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 -- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff02c15be40 msgr2=0x7ff02c140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:09.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff02c15be40 0x7ff02c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.427+0000 7ff02be00640 1 -- 172.21.15.16:0/3497622650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c1577d0 con 0x7ff02c0c5a20 2024-04-17T15:10:09.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.431+0000 7ff02be00640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c7a0 tx=0x7ff01c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c017070 con 0x7ff02c0c5a20 2024-04-17T15:10:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c003db0 con 0x7ff02c0c5a20 2024-04-17T15:10:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0052b0 con 0x7ff02c0c5a20 2024-04-17T15:10:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02c0c7780 con 0x7ff02c0c5a20 2024-04-17T15:10:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02c0c8990 con 0x7ff02c0c5a20 2024-04-17T15:10:09.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.435+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02c076280 con 0x7ff02c0c5a20 2024-04-17T15:10:09.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.711+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff01c01a070 con 0x7ff02c0c5a20 2024-04-17T15:10:09.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.715+0000 7ff028c00640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 0x7ff00806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:09.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.715+0000 7ff023400640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 0x7ff00806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:09.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.715+0000 7ff023400640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 0x7ff00806a890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0140b3000 tx=0x7ff014008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:09.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.727+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff01c054500 con 0x7ff02c0c5a20 2024-04-17T15:10:09.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.727+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff01c021020 con 0x7ff02c0c5a20 2024-04-17T15:10:09.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.887+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff02c06fb90 con 0x7ff0080683d0 2024-04-17T15:10:09.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.907+0000 7ff028c00640 1 -- 172.21.15.16:0/3497622650 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253037 (secure 0 0 0) 0x7ff02c06fb90 con 0x7ff0080683d0 2024-04-17T15:10:09.911 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:09.913 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T15:10:09.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 msgr2=0x7ff00806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:09.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 0x7ff00806a890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0140b3000 tx=0x7ff014008040 comp rx=0 tx=0).stop 2024-04-17T15:10:09.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 msgr2=0x7ff02c1473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c7a0 tx=0x7ff01c00cc60 comp rx=0 tx=0).stop 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 shutdown_connections 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff0080683d0 0x7ff00806a890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff02c15be40 0x7ff02c140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff02c151db0 0x7ff02c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 --2- 172.21.15.16:0/3497622650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff02c0c5a20 0x7ff02c1473d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 >> 172.21.15.16:0/3497622650 conn(0x7ff02c06ba30 msgr2=0x7ff02c072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 shutdown_connections 2024-04-17T15:10:09.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:09.911+0000 7ff033200640 1 -- 172.21.15.16:0/3497622650 wait complete. 2024-04-17T15:10:09.931 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":946,"stamp":"2024-04-17T15:10:09.715646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39264798,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1257,"num_read_kb":137983,"num_write":14341,"num_write_kb":371145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13471,"ondisk_log_size":13471,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":348984,"kb_used_data":78776,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754625736,"statfs":{"total":773094113280,"available":772736753664,"internally_reserved":0,"allocated":80666624,"data_stored":79285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":155202,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":54,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004792"},"pg_stats":[{"pgid":"3.3f","version":"25'55","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158881+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T15:09:32.158881+0000","last_peered":"2024-04-17T15:09:32.158881+0000","last_clean":"2024-04-17T15:09:32.158881+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T15:09:32.158881+0000","last_undegraded":"2024-04-17T15:09:32.158881+0000","last_fullsized":"2024-04-17T15:09:32.158881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":45,"num_write_kb":3409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'69","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:11.677273+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T15:09:11.677273+0000","last_peered":"2024-04-17T15:09:11.677273+0000","last_clean":"2024-04-17T15:09:11.677273+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T15:09:11.677273+0000","last_undegraded":"2024-04-17T15:09:11.677273+0000","last_fullsized":"2024-04-17T15:09:11.677273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":60,"num_write_kb":3465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'77","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.150829+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T15:09:30.150829+0000","last_peered":"2024-04-17T15:09:30.150829+0000","last_clean":"2024-04-17T15:09:30.150829+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T15:09:30.150829+0000","last_undegraded":"2024-04-17T15:09:30.150829+0000","last_fullsized":"2024-04-17T15:09:30.150829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":2861,"num_write":63,"num_write_kb":6749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'48","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.419606+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T15:09:36.419606+0000","last_peered":"2024-04-17T15:09:36.419606+0000","last_clean":"2024-04-17T15:09:36.419606+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T15:09:36.419606+0000","last_undegraded":"2024-04-17T15:09:36.419606+0000","last_fullsized":"2024-04-17T15:09:36.419606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'94","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.983411+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T15:09:29.983411+0000","last_peered":"2024-04-17T15:09:29.983411+0000","last_clean":"2024-04-17T15:09:29.983411+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T15:09:29.983411+0000","last_undegraded":"2024-04-17T15:09:29.983411+0000","last_fullsized":"2024-04-17T15:09:29.983411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2548,"num_write":80,"num_write_kb":4150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'92","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.151778+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T15:09:09.151778+0000","last_peered":"2024-04-17T15:09:09.151778+0000","last_clean":"2024-04-17T15:09:09.151778+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T15:09:09.151778+0000","last_undegraded":"2024-04-17T15:09:09.151778+0000","last_fullsized":"2024-04-17T15:09:09.151778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":80,"num_write_kb":2528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'96","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.336862+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T15:09:32.336862+0000","last_peered":"2024-04-17T15:09:32.336862+0000","last_clean":"2024-04-17T15:09:32.336862+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T15:09:32.336862+0000","last_undegraded":"2024-04-17T15:09:32.336862+0000","last_fullsized":"2024-04-17T15:09:32.336862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":86,"num_write_kb":7600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'70","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.351217+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T15:09:36.351217+0000","last_peered":"2024-04-17T15:09:36.351217+0000","last_clean":"2024-04-17T15:09:36.351217+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T15:09:36.351217+0000","last_undegraded":"2024-04-17T15:09:36.351217+0000","last_fullsized":"2024-04-17T15:09:36.351217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1525,"num_write":67,"num_write_kb":3989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'77","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608023+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T15:09:32.608023+0000","last_peered":"2024-04-17T15:09:32.608023+0000","last_clean":"2024-04-17T15:09:32.608023+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T15:09:32.608023+0000","last_undegraded":"2024-04-17T15:09:32.608023+0000","last_fullsized":"2024-04-17T15:09:32.608023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":58,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.354385+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T15:09:13.354385+0000","last_peered":"2024-04-17T15:09:13.354385+0000","last_clean":"2024-04-17T15:09:13.354385+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T15:09:13.354385+0000","last_undegraded":"2024-04-17T15:09:13.354385+0000","last_fullsized":"2024-04-17T15:09:13.354385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":61,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'84","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:03.720201+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T15:09:03.720201+0000","last_peered":"2024-04-17T15:09:03.720201+0000","last_clean":"2024-04-17T15:09:03.720201+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T15:09:03.720201+0000","last_undegraded":"2024-04-17T15:09:03.720201+0000","last_fullsized":"2024-04-17T15:09:03.720201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":68,"num_write_kb":6389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'54","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.043518+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T15:09:09.043518+0000","last_peered":"2024-04-17T15:09:09.043518+0000","last_clean":"2024-04-17T15:09:09.043518+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T15:09:09.043518+0000","last_undegraded":"2024-04-17T15:09:09.043518+0000","last_fullsized":"2024-04-17T15:09:09.043518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":46,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'54","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.355878+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T15:09:32.355878+0000","last_peered":"2024-04-17T15:09:32.355878+0000","last_clean":"2024-04-17T15:09:32.355878+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T15:09:32.355878+0000","last_undegraded":"2024-04-17T15:09:32.355878+0000","last_fullsized":"2024-04-17T15:09:32.355878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'79","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.101323+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T15:09:32.101323+0000","last_peered":"2024-04-17T15:09:32.101323+0000","last_clean":"2024-04-17T15:09:32.101323+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T15:09:32.101323+0000","last_undegraded":"2024-04-17T15:09:32.101323+0000","last_fullsized":"2024-04-17T15:09:32.101323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":67,"num_write_kb":3643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'81","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.528532+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T15:09:32.528532+0000","last_peered":"2024-04-17T15:09:32.528532+0000","last_clean":"2024-04-17T15:09:32.528532+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T15:09:32.528532+0000","last_undegraded":"2024-04-17T15:09:32.528532+0000","last_fullsized":"2024-04-17T15:09:32.528532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6351,"num_write":71,"num_write_kb":4827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'88","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078248+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T15:09:32.078248+0000","last_peered":"2024-04-17T15:09:32.078248+0000","last_clean":"2024-04-17T15:09:32.078248+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T15:09:32.078248+0000","last_undegraded":"2024-04-17T15:09:32.078248+0000","last_fullsized":"2024-04-17T15:09:32.078248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2606,"num_write":80,"num_write_kb":5984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353369+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T15:08:49.353369+0000","last_peered":"2024-04-17T15:08:49.353369+0000","last_clean":"2024-04-17T15:08:49.353369+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T15:08:49.353369+0000","last_undegraded":"2024-04-17T15:08:49.353369+0000","last_fullsized":"2024-04-17T15:08:49.353369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":64,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'82","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.133194+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T15:09:30.133194+0000","last_peered":"2024-04-17T15:09:30.133194+0000","last_clean":"2024-04-17T15:09:30.133194+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T15:09:30.133194+0000","last_undegraded":"2024-04-17T15:09:30.133194+0000","last_fullsized":"2024-04-17T15:09:30.133194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":64,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'67","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.140239+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T15:09:30.140239+0000","last_peered":"2024-04-17T15:09:30.140239+0000","last_clean":"2024-04-17T15:09:30.140239+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T15:09:30.140239+0000","last_undegraded":"2024-04-17T15:09:30.140239+0000","last_fullsized":"2024-04-17T15:09:30.140239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":51,"num_write_kb":3336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'105","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158895+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T15:09:32.158895+0000","last_peered":"2024-04-17T15:09:32.158895+0000","last_clean":"2024-04-17T15:09:32.158895+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T15:09:32.158895+0000","last_undegraded":"2024-04-17T15:09:32.158895+0000","last_fullsized":"2024-04-17T15:09:32.158895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":94,"num_write_kb":5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'96","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.301698+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T15:09:32.301698+0000","last_peered":"2024-04-17T15:09:32.301698+0000","last_clean":"2024-04-17T15:09:32.301698+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T15:09:32.301698+0000","last_undegraded":"2024-04-17T15:09:32.301698+0000","last_fullsized":"2024-04-17T15:09:32.301698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":82,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'73","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.897747+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T15:09:13.897747+0000","last_peered":"2024-04-17T15:09:13.897747+0000","last_clean":"2024-04-17T15:09:13.897747+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T15:09:13.897747+0000","last_undegraded":"2024-04-17T15:09:13.897747+0000","last_fullsized":"2024-04-17T15:09:13.897747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":63,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'72","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244648+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T15:09:32.244648+0000","last_peered":"2024-04-17T15:09:32.244648+0000","last_clean":"2024-04-17T15:09:32.244648+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T15:09:32.244648+0000","last_undegraded":"2024-04-17T15:09:32.244648+0000","last_fullsized":"2024-04-17T15:09:32.244648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":54,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.963165+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T15:09:29.963165+0000","last_peered":"2024-04-17T15:09:29.963165+0000","last_clean":"2024-04-17T15:09:29.963165+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T15:09:29.963165+0000","last_undegraded":"2024-04-17T15:09:29.963165+0000","last_fullsized":"2024-04-17T15:09:29.963165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":45,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'88","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.271782+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T15:09:23.271782+0000","last_peered":"2024-04-17T15:09:23.271782+0000","last_clean":"2024-04-17T15:09:23.271782+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T15:09:23.271782+0000","last_undegraded":"2024-04-17T15:09:23.271782+0000","last_fullsized":"2024-04-17T15:09:23.271782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":81,"num_write_kb":3963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'78","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.150904+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T15:09:09.150904+0000","last_peered":"2024-04-17T15:09:09.150904+0000","last_clean":"2024-04-17T15:09:09.150904+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T15:09:09.150904+0000","last_undegraded":"2024-04-17T15:09:09.150904+0000","last_fullsized":"2024-04-17T15:09:09.150904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":63,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'119","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.356705+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T15:09:32.356705+0000","last_peered":"2024-04-17T15:09:32.356705+0000","last_clean":"2024-04-17T15:09:32.356705+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T15:09:32.356705+0000","last_undegraded":"2024-04-17T15:09:32.356705+0000","last_fullsized":"2024-04-17T15:09:32.356705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":109,"num_write_kb":10749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'55","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795783+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T15:09:17.795783+0000","last_peered":"2024-04-17T15:09:17.795783+0000","last_clean":"2024-04-17T15:09:17.795783+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T15:09:17.795783+0000","last_undegraded":"2024-04-17T15:09:17.795783+0000","last_fullsized":"2024-04-17T15:09:17.795783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2802,"num_write":38,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:21.535684+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T15:09:21.535684+0000","last_peered":"2024-04-17T15:09:21.535684+0000","last_clean":"2024-04-17T15:09:21.535684+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T15:09:21.535684+0000","last_undegraded":"2024-04-17T15:09:21.535684+0000","last_fullsized":"2024-04-17T15:09:21.535684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":55,"num_write_kb":3974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'145","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.927590+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T15:09:29.927590+0000","last_peered":"2024-04-17T15:09:29.927590+0000","last_clean":"2024-04-17T15:09:29.927590+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T15:09:29.927590+0000","last_undegraded":"2024-04-17T15:09:29.927590+0000","last_fullsized":"2024-04-17T15:09:29.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":133,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'86","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.407804+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T15:09:32.407804+0000","last_peered":"2024-04-17T15:09:32.407804+0000","last_clean":"2024-04-17T15:09:32.407804+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T15:09:32.407804+0000","last_undegraded":"2024-04-17T15:09:32.407804+0000","last_fullsized":"2024-04-17T15:09:32.407804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3049,"num_write":71,"num_write_kb":6543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.404890+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T15:09:32.404890+0000","last_peered":"2024-04-17T15:09:32.404890+0000","last_clean":"2024-04-17T15:09:32.404890+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T15:09:32.404890+0000","last_undegraded":"2024-04-17T15:09:32.404890+0000","last_fullsized":"2024-04-17T15:09:32.404890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":57,"num_write_kb":6003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.157699+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T15:09:32.157699+0000","last_peered":"2024-04-17T15:09:32.157699+0000","last_clean":"2024-04-17T15:09:32.157699+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T15:09:32.157699+0000","last_undegraded":"2024-04-17T15:09:32.157699+0000","last_fullsized":"2024-04-17T15:09:32.157699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":59,"num_write_kb":5350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'768","reported_seq":800,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.541856+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T15:10:01.541856+0000","last_peered":"2024-04-17T15:10:01.541856+0000","last_clean":"2024-04-17T15:10:01.541856+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T15:10:01.541856+0000","last_undegraded":"2024-04-17T15:10:01.541856+0000","last_fullsized":"2024-04-17T15:10:01.541856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.372991+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T15:09:36.372991+0000","last_peered":"2024-04-17T15:09:36.372991+0000","last_clean":"2024-04-17T15:09:36.372991+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T15:09:36.372991+0000","last_undegraded":"2024-04-17T15:09:36.372991+0000","last_fullsized":"2024-04-17T15:09:36.372991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2033,"num_write":68,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'541","reported_seq":573,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.089549+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T15:09:57.089549+0000","last_peered":"2024-04-17T15:09:57.089549+0000","last_clean":"2024-04-17T15:09:57.089549+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T15:09:57.089549+0000","last_undegraded":"2024-04-17T15:09:57.089549+0000","last_fullsized":"2024-04-17T15:09:57.089549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'6","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807877+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T15:09:51.807877+0000","last_peered":"2024-04-17T15:09:51.807877+0000","last_clean":"2024-04-17T15:09:51.807877+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T15:09:51.807877+0000","last_undegraded":"2024-04-17T15:09:51.807877+0000","last_fullsized":"2024-04-17T15:09:51.807877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.529371+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T15:09:32.529371+0000","last_peered":"2024-04-17T15:09:32.529371+0000","last_clean":"2024-04-17T15:09:32.529371+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T15:09:32.529371+0000","last_undegraded":"2024-04-17T15:09:32.529371+0000","last_fullsized":"2024-04-17T15:09:32.529371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":71,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.696010+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T15:08:58.696010+0000","last_peered":"2024-04-17T15:08:58.696010+0000","last_clean":"2024-04-17T15:08:58.696010+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T15:08:58.696010+0000","last_undegraded":"2024-04-17T15:08:58.696010+0000","last_fullsized":"2024-04-17T15:08:58.696010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'74","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.178722+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T15:09:13.178722+0000","last_peered":"2024-04-17T15:09:13.178722+0000","last_clean":"2024-04-17T15:09:13.178722+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T15:09:13.178722+0000","last_undegraded":"2024-04-17T15:09:13.178722+0000","last_fullsized":"2024-04-17T15:09:13.178722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":63,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.896466+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T15:08:58.896466+0000","last_peered":"2024-04-17T15:08:58.896466+0000","last_clean":"2024-04-17T15:08:58.896466+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T15:08:58.896466+0000","last_undegraded":"2024-04-17T15:08:58.896466+0000","last_fullsized":"2024-04-17T15:08:58.896466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.238470+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T15:09:32.238470+0000","last_peered":"2024-04-17T15:09:32.238470+0000","last_clean":"2024-04-17T15:09:32.238470+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T15:09:32.238470+0000","last_undegraded":"2024-04-17T15:09:32.238470+0000","last_fullsized":"2024-04-17T15:09:32.238470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1337,"num_write":72,"num_write_kb":6000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'3","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.636328+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T15:09:41.636328+0000","last_peered":"2024-04-17T15:09:41.636328+0000","last_clean":"2024-04-17T15:09:41.636328+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T15:09:41.636328+0000","last_undegraded":"2024-04-17T15:09:41.636328+0000","last_fullsized":"2024-04-17T15:09:41.636328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'75","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244057+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T15:09:32.244057+0000","last_peered":"2024-04-17T15:09:32.244057+0000","last_clean":"2024-04-17T15:09:32.244057+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T15:09:32.244057+0000","last_undegraded":"2024-04-17T15:09:32.244057+0000","last_fullsized":"2024-04-17T15:09:32.244057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":59,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'391","reported_seq":423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.585352+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T15:10:01.585352+0000","last_peered":"2024-04-17T15:10:01.585352+0000","last_clean":"2024-04-17T15:10:01.585352+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T15:10:01.585352+0000","last_undegraded":"2024-04-17T15:10:01.585352+0000","last_fullsized":"2024-04-17T15:10:01.585352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'73","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078004+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T15:09:32.078004+0000","last_peered":"2024-04-17T15:09:32.078004+0000","last_clean":"2024-04-17T15:09:32.078004+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T15:09:32.078004+0000","last_undegraded":"2024-04-17T15:09:32.078004+0000","last_fullsized":"2024-04-17T15:09:32.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":63,"num_write_kb":3236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'925","reported_seq":957,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301326+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T15:10:04.301326+0000","last_peered":"2024-04-17T15:10:04.301326+0000","last_clean":"2024-04-17T15:10:04.301326+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T15:10:04.301326+0000","last_undegraded":"2024-04-17T15:10:04.301326+0000","last_fullsized":"2024-04-17T15:10:04.301326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":4530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'79","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.090178+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T15:09:30.090178+0000","last_peered":"2024-04-17T15:09:30.090178+0000","last_clean":"2024-04-17T15:09:30.090178+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T15:09:30.090178+0000","last_undegraded":"2024-04-17T15:09:30.090178+0000","last_fullsized":"2024-04-17T15:09:30.090178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":66,"num_write_kb":2869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'63","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301348+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T15:10:04.301348+0000","last_peered":"2024-04-17T15:10:04.301348+0000","last_clean":"2024-04-17T15:10:04.301348+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T15:10:04.301348+0000","last_undegraded":"2024-04-17T15:10:04.301348+0000","last_fullsized":"2024-04-17T15:10:04.301348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680040,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'76","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.153660+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T15:09:30.153660+0000","last_peered":"2024-04-17T15:09:30.153660+0000","last_clean":"2024-04-17T15:09:30.153660+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T15:09:30.153660+0000","last_undegraded":"2024-04-17T15:09:30.153660+0000","last_fullsized":"2024-04-17T15:09:30.153660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1082,"num_write":62,"num_write_kb":6883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'8","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.747281+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T15:10:06.747281+0000","last_peered":"2024-04-17T15:10:06.747281+0000","last_clean":"2024-04-17T15:10:06.747281+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T15:10:06.747281+0000","last_undegraded":"2024-04-17T15:10:06.747281+0000","last_fullsized":"2024-04-17T15:10:06.747281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'103","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608652+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T15:09:32.608652+0000","last_peered":"2024-04-17T15:09:32.608652+0000","last_clean":"2024-04-17T15:09:32.608652+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T15:09:32.608652+0000","last_undegraded":"2024-04-17T15:09:32.608652+0000","last_fullsized":"2024-04-17T15:09:32.608652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:47.607063+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T15:09:47.607063+0000","last_peered":"2024-04-17T15:09:47.607063+0000","last_clean":"2024-04-17T15:09:47.607063+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T15:09:47.607063+0000","last_undegraded":"2024-04-17T15:09:47.607063+0000","last_fullsized":"2024-04-17T15:09:47.607063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.156988+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T15:09:32.156988+0000","last_peered":"2024-04-17T15:09:32.156988+0000","last_clean":"2024-04-17T15:09:32.156988+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T15:09:32.156988+0000","last_undegraded":"2024-04-17T15:09:32.156988+0000","last_fullsized":"2024-04-17T15:09:32.156988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":55,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626072+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T15:09:41.626072+0000","last_peered":"2024-04-17T15:09:41.626072+0000","last_clean":"2024-04-17T15:09:41.626072+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T15:09:41.626072+0000","last_undegraded":"2024-04-17T15:09:41.626072+0000","last_fullsized":"2024-04-17T15:09:41.626072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.259115+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T15:09:13.259115+0000","last_peered":"2024-04-17T15:09:13.259115+0000","last_clean":"2024-04-17T15:09:13.259115+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T15:09:13.259115+0000","last_undegraded":"2024-04-17T15:09:13.259115+0000","last_fullsized":"2024-04-17T15:09:13.259115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3310,"num_write":61,"num_write_kb":6412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:56.950030+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T15:09:56.950030+0000","last_peered":"2024-04-17T15:09:56.950030+0000","last_clean":"2024-04-17T15:09:56.950030+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T15:09:56.950030+0000","last_undegraded":"2024-04-17T15:09:56.950030+0000","last_fullsized":"2024-04-17T15:09:56.950030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'40","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.108126+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T15:09:13.108126+0000","last_peered":"2024-04-17T15:09:13.108126+0000","last_clean":"2024-04-17T15:09:13.108126+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T15:09:13.108126+0000","last_undegraded":"2024-04-17T15:09:13.108126+0000","last_fullsized":"2024-04-17T15:09:13.108126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":33,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.693051+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T15:09:13.693051+0000","last_peered":"2024-04-17T15:09:13.693051+0000","last_clean":"2024-04-17T15:09:13.693051+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T15:09:13.693051+0000","last_undegraded":"2024-04-17T15:09:13.693051+0000","last_fullsized":"2024-04-17T15:09:13.693051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'60","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:43.557898+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T15:08:43.557898+0000","last_peered":"2024-04-17T15:08:43.557898+0000","last_clean":"2024-04-17T15:08:43.557898+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T15:08:43.557898+0000","last_undegraded":"2024-04-17T15:08:43.557898+0000","last_fullsized":"2024-04-17T15:08:43.557898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":47,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'4","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.784425+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T15:09:51.784425+0000","last_peered":"2024-04-17T15:09:51.784425+0000","last_clean":"2024-04-17T15:09:51.784425+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T15:09:51.784425+0000","last_undegraded":"2024-04-17T15:09:51.784425+0000","last_fullsized":"2024-04-17T15:09:51.784425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'88","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.583653+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T15:09:32.583653+0000","last_peered":"2024-04-17T15:09:32.583653+0000","last_clean":"2024-04-17T15:09:32.583653+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T15:09:32.583653+0000","last_undegraded":"2024-04-17T15:09:32.583653+0000","last_fullsized":"2024-04-17T15:09:32.583653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":1779,"num_write":77,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807444+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T15:09:51.807444+0000","last_peered":"2024-04-17T15:09:51.807444+0000","last_clean":"2024-04-17T15:09:51.807444+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T15:09:51.807444+0000","last_undegraded":"2024-04-17T15:09:51.807444+0000","last_fullsized":"2024-04-17T15:09:51.807444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353180+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T15:08:49.353180+0000","last_peered":"2024-04-17T15:08:49.353180+0000","last_clean":"2024-04-17T15:08:49.353180+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T15:08:49.353180+0000","last_undegraded":"2024-04-17T15:08:49.353180+0000","last_fullsized":"2024-04-17T15:08:49.353180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":68,"num_write_kb":2018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:07:23.887226+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T15:07:23.887226+0000","last_peered":"2024-04-17T15:07:23.887226+0000","last_clean":"2024-04-17T15:07:23.887226+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T15:07:23.887226+0000","last_undegraded":"2024-04-17T15:07:23.887226+0000","last_fullsized":"2024-04-17T15:07:23.887226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'7","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652462+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T15:10:01.652462+0000","last_peered":"2024-04-17T15:10:01.652462+0000","last_clean":"2024-04-17T15:10:01.652462+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T15:10:01.652462+0000","last_undegraded":"2024-04-17T15:10:01.652462+0000","last_fullsized":"2024-04-17T15:10:01.652462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:38.539265+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T15:08:38.539265+0000","last_peered":"2024-04-17T15:08:38.539265+0000","last_clean":"2024-04-17T15:08:38.539265+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T15:08:38.539265+0000","last_undegraded":"2024-04-17T15:08:38.539265+0000","last_fullsized":"2024-04-17T15:08:38.539265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2040,"num_write":75,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'211","reported_seq":246,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.097540+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T15:09:57.097540+0000","last_peered":"2024-04-17T15:09:57.097540+0000","last_clean":"2024-04-17T15:09:57.097540+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T15:09:57.097540+0000","last_undegraded":"2024-04-17T15:09:57.097540+0000","last_fullsized":"2024-04-17T15:09:57.097540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'80","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795863+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T15:09:17.795863+0000","last_peered":"2024-04-17T15:09:17.795863+0000","last_clean":"2024-04-17T15:09:17.795863+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T15:09:17.795863+0000","last_undegraded":"2024-04-17T15:09:17.795863+0000","last_fullsized":"2024-04-17T15:09:17.795863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":73,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'621","reported_seq":1270,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.543365+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T15:10:01.543365+0000","last_peered":"2024-04-17T15:10:01.543365+0000","last_clean":"2024-04-17T15:10:01.543365+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T15:10:01.543365+0000","last_undegraded":"2024-04-17T15:10:01.543365+0000","last_fullsized":"2024-04-17T15:10:01.543365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244218,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":617,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'63","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.245350+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T15:09:32.245350+0000","last_peered":"2024-04-17T15:09:32.245350+0000","last_clean":"2024-04-17T15:09:32.245350+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T15:09:32.245350+0000","last_undegraded":"2024-04-17T15:09:32.245350+0000","last_fullsized":"2024-04-17T15:09:32.245350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":53,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.718195+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T15:10:06.718195+0000","last_peered":"2024-04-17T15:10:06.718195+0000","last_clean":"2024-04-17T15:10:06.718195+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T15:10:06.718195+0000","last_undegraded":"2024-04-17T15:10:06.718195+0000","last_fullsized":"2024-04-17T15:10:06.718195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'57","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.104672+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T15:09:32.104672+0000","last_peered":"2024-04-17T15:09:32.104672+0000","last_clean":"2024-04-17T15:09:32.104672+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T15:09:32.104672+0000","last_undegraded":"2024-04-17T15:09:32.104672+0000","last_fullsized":"2024-04-17T15:09:32.104672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":47,"num_write_kb":3555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.785304+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T15:09:51.785304+0000","last_peered":"2024-04-17T15:09:51.785304+0000","last_clean":"2024-04-17T15:09:51.785304+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T15:09:51.785304+0000","last_undegraded":"2024-04-17T15:09:51.785304+0000","last_fullsized":"2024-04-17T15:09:51.785304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'76","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:08.815706+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T15:09:08.815706+0000","last_peered":"2024-04-17T15:09:08.815706+0000","last_clean":"2024-04-17T15:09:08.815706+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T15:09:08.815706+0000","last_undegraded":"2024-04-17T15:09:08.815706+0000","last_fullsized":"2024-04-17T15:09:08.815706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":66,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.651305+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T15:10:01.651305+0000","last_peered":"2024-04-17T15:10:01.651305+0000","last_clean":"2024-04-17T15:10:01.651305+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T15:10:01.651305+0000","last_undegraded":"2024-04-17T15:10:01.651305+0000","last_fullsized":"2024-04-17T15:10:01.651305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'76","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.019032+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T15:09:09.019032+0000","last_peered":"2024-04-17T15:09:09.019032+0000","last_clean":"2024-04-17T15:09:09.019032+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T15:09:09.019032+0000","last_undegraded":"2024-04-17T15:09:09.019032+0000","last_fullsized":"2024-04-17T15:09:09.019032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":61,"num_write_kb":2647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1175","reported_seq":1208,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.857741+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T15:10:04.857741+0000","last_peered":"2024-04-17T15:10:04.857741+0000","last_clean":"2024-04-17T15:10:04.857741+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T15:10:04.857741+0000","last_undegraded":"2024-04-17T15:10:04.857741+0000","last_fullsized":"2024-04-17T15:10:04.857741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2894,"num_write_kb":1176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'85","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.299288+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T15:09:32.299288+0000","last_peered":"2024-04-17T15:09:32.299288+0000","last_clean":"2024-04-17T15:09:32.299288+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T15:09:32.299288+0000","last_undegraded":"2024-04-17T15:09:32.299288+0000","last_fullsized":"2024-04-17T15:09:32.299288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3434,"num_write":74,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'9","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.650974+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T15:10:01.650974+0000","last_peered":"2024-04-17T15:10:01.650974+0000","last_clean":"2024-04-17T15:10:01.650974+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T15:10:01.650974+0000","last_undegraded":"2024-04-17T15:10:01.650974+0000","last_fullsized":"2024-04-17T15:10:01.650974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.212615+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T15:09:30.212615+0000","last_peered":"2024-04-17T15:09:30.212615+0000","last_clean":"2024-04-17T15:09:30.212615+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T15:09:30.212615+0000","last_undegraded":"2024-04-17T15:09:30.212615+0000","last_fullsized":"2024-04-17T15:09:30.212615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":52,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.647588+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T15:10:01.647588+0000","last_peered":"2024-04-17T15:10:01.647588+0000","last_clean":"2024-04-17T15:10:01.647588+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T15:10:01.647588+0000","last_undegraded":"2024-04-17T15:10:01.647588+0000","last_fullsized":"2024-04-17T15:10:01.647588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'98","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.068750+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T15:09:23.068750+0000","last_peered":"2024-04-17T15:09:23.068750+0000","last_clean":"2024-04-17T15:09:23.068750+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T15:09:23.068750+0000","last_undegraded":"2024-04-17T15:09:23.068750+0000","last_fullsized":"2024-04-17T15:09:23.068750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2098,"num_write":85,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'6","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.813018+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T15:09:51.813018+0000","last_peered":"2024-04-17T15:09:51.813018+0000","last_clean":"2024-04-17T15:09:51.813018+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T15:09:51.813018+0000","last_undegraded":"2024-04-17T15:09:51.813018+0000","last_fullsized":"2024-04-17T15:09:51.813018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'63","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.300278+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T15:09:32.300278+0000","last_peered":"2024-04-17T15:09:32.300278+0000","last_clean":"2024-04-17T15:09:32.300278+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T15:09:32.300278+0000","last_undegraded":"2024-04-17T15:09:32.300278+0000","last_fullsized":"2024-04-17T15:09:32.300278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":50,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'2","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807732+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T15:09:51.807732+0000","last_peered":"2024-04-17T15:09:51.807732+0000","last_clean":"2024-04-17T15:09:51.807732+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T15:09:51.807732+0000","last_undegraded":"2024-04-17T15:09:51.807732+0000","last_fullsized":"2024-04-17T15:09:51.807732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'75","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.911205+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T15:09:29.911205+0000","last_peered":"2024-04-17T15:09:29.911205+0000","last_clean":"2024-04-17T15:09:29.911205+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T15:09:29.911205+0000","last_undegraded":"2024-04-17T15:09:29.911205+0000","last_fullsized":"2024-04-17T15:09:29.911205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":67,"num_write_kb":4068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'778","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652042+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T15:10:01.652042+0000","last_peered":"2024-04-17T15:10:01.652042+0000","last_clean":"2024-04-17T15:10:01.652042+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T15:10:01.652042+0000","last_undegraded":"2024-04-17T15:10:01.652042+0000","last_fullsized":"2024-04-17T15:10:01.652042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'119","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.926443+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T15:09:29.926443+0000","last_peered":"2024-04-17T15:09:29.926443+0000","last_clean":"2024-04-17T15:09:29.926443+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T15:09:29.926443+0000","last_undegraded":"2024-04-17T15:09:29.926443+0000","last_fullsized":"2024-04-17T15:09:29.926443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":110,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.066946+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T15:09:23.066946+0000","last_peered":"2024-04-17T15:09:23.066946+0000","last_clean":"2024-04-17T15:09:23.066946+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T15:09:23.066946+0000","last_undegraded":"2024-04-17T15:09:23.066946+0000","last_fullsized":"2024-04-17T15:09:23.066946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2294,"num_write":58,"num_write_kb":5884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.085826+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T15:09:57.085826+0000","last_peered":"2024-04-17T15:09:57.085826+0000","last_clean":"2024-04-17T15:09:57.085826+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T15:09:57.085826+0000","last_undegraded":"2024-04-17T15:09:57.085826+0000","last_fullsized":"2024-04-17T15:09:57.085826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'62","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.353652+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T15:09:36.353652+0000","last_peered":"2024-04-17T15:09:36.353652+0000","last_clean":"2024-04-17T15:09:36.353652+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T15:09:36.353652+0000","last_undegraded":"2024-04-17T15:09:36.353652+0000","last_fullsized":"2024-04-17T15:09:36.353652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":47,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1266","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.648803+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T15:10:01.648803+0000","last_peered":"2024-04-17T15:10:01.648803+0000","last_clean":"2024-04-17T15:10:01.648803+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T15:10:01.648803+0000","last_undegraded":"2024-04-17T15:10:01.648803+0000","last_fullsized":"2024-04-17T15:10:01.648803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":8829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'116","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:34.452732+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T15:08:34.452732+0000","last_peered":"2024-04-17T15:08:34.452732+0000","last_clean":"2024-04-17T15:08:34.452732+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T15:08:34.452732+0000","last_undegraded":"2024-04-17T15:08:34.452732+0000","last_fullsized":"2024-04-17T15:08:34.452732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":107,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'779","reported_seq":813,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.740693+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T15:09:41.740693+0000","last_peered":"2024-04-17T15:09:41.740693+0000","last_clean":"2024-04-17T15:09:41.740693+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T15:09:41.740693+0000","last_undegraded":"2024-04-17T15:09:41.740693+0000","last_fullsized":"2024-04-17T15:09:41.740693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'90","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.889222+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T15:09:29.889222+0000","last_peered":"2024-04-17T15:09:29.889222+0000","last_clean":"2024-04-17T15:09:29.889222+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T15:09:29.889222+0000","last_undegraded":"2024-04-17T15:09:29.889222+0000","last_fullsized":"2024-04-17T15:09:29.889222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":83,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'707","reported_seq":741,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626443+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T15:09:41.626443+0000","last_peered":"2024-04-17T15:09:41.626443+0000","last_clean":"2024-04-17T15:09:41.626443+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T15:09:41.626443+0000","last_undegraded":"2024-04-17T15:09:41.626443+0000","last_fullsized":"2024-04-17T15:09:41.626443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":137179,"num_write":4261,"num_write_kb":326145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5036,"ondisk_log_size":5036,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38674430,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":9921,"num_write_kb":42584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77422592,"data_stored":77360270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8318,"ondisk_log_size":8318,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509815,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":4452352,"data_stored":4288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":8460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":8663040,"data_stored":8484412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43656,"kb_used_data":16640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328184,"statfs":{"total":96636764160,"available":96592060416,"internally_reserved":0,"allocated":17039360,"data_stored":16872258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509814,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52108,"kb_used_data":8452,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319732,"statfs":{"total":96636764160,"available":96583405568,"internally_reserved":0,"allocated":8654848,"data_stored":8483740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509815,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48524,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323316,"statfs":{"total":96636764160,"available":96587075584,"internally_reserved":0,"allocated":9244672,"data_stored":9073506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509815,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44392,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327448,"statfs":{"total":96636764160,"available":96591306752,"internally_reserved":0,"allocated":13533184,"data_stored":13357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":5390336,"data_stored":5213112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542518,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40384,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":13688832,"data_stored":13512050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13283328,"data_stored":13274384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12836864,"data_stored":12827222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5132288,"data_stored":5118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:10:09.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:10:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.111+0000 7f4843000640 1 Processor -- start 2024-04-17T15:10:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4843000640 1 -- start start 2024-04-17T15:10:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4843000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 0x7f483c071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4843000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c072590 con 0x7f483c073470 2024-04-17T15:10:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4843000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c0c8b00 con 0x7f483c15ab20 2024-04-17T15:10:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4843000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f483c072fe0 con 0x7f483c154dd0 2024-04-17T15:10:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4841200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f483c073470 0x7f483c0c73b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52594/0 (socket says 172.21.15.16:52594) 2024-04-17T15:10:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4841200640 1 -- 172.21.15.16:0/2534793632 learned_addr learned my addr 172.21.15.16:0/2534793632 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:10.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.115+0000 7f4841c00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 0x7f483c071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.119+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879587361 0 0) 0x7f483c072590 con 0x7f483c073470 2024-04-17T15:10:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.119+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4824003530 con 0x7f483c073470 2024-04-17T15:10:10.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3482588029 0 0) 0x7f4824003530 con 0x7f483c073470 2024-04-17T15:10:10.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 msgr2=0x7f483c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:10.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 0x7f483c071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 >> v1:172.21.15.67:6789/0 conn(0x7f483c15ab20 legacy=0x7f483c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c0c8de0 con 0x7f483c073470 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f4828001680 con 0x7f483c073470 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 >> v1:172.21.15.16:6789/0 conn(0x7f483c073470 legacy=0x7f483c0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48240039f0 0x7f4824003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 0x7f4824004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4824004d50 0x7f48240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f483c072fe0 con 0x7f48240039f0 2024-04-17T15:10:10.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f482400ba80 con 0x7f4824004d50 2024-04-17T15:10:10.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f482400bc80 con 0x7f483c154dd0 2024-04-17T15:10:10.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.123+0000 7f4841c00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48240039f0 0x7f4824003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.127+0000 7f4841c00640 1 -- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 msgr2=0x7f4824004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:10.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.127+0000 7f4841c00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f483c154dd0 0x7f4824004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.127+0000 7f4841c00640 1 -- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4824004d50 msgr2=0x7f48240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:10.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.127+0000 7f4841c00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4824004d50 0x7f48240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.127+0000 7f4841c00640 1 -- 172.21.15.16:0/2534793632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4824003530 con 0x7f48240039f0 2024-04-17T15:10:10.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.131+0000 7f4841c00640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48240039f0 0x7f4824003e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4830009ab0 tx=0x7f483001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac43734ecf837fba server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:10.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300096b0 con 0x7f48240039f0 2024-04-17T15:10:10.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48300a6470 con 0x7f48240039f0 2024-04-17T15:10:10.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f483be00640 1 -- 172.21.15.16:0/2534793632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300a68a0 con 0x7f48240039f0 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 -- 172.21.15.16:0/2534793632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48240039f0 msgr2=0x7f4824003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 --2- 172.21.15.16:0/2534793632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48240039f0 0x7f4824003e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4830009ab0 tx=0x7f483001ca90 comp rx=0 tx=0).stop 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4842600640 1 -- 172.21.15.16:0/2534793632 reap_dead start 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 -- 172.21.15.16:0/2534793632 shutdown_connections 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 -- 172.21.15.16:0/2534793632 >> 172.21.15.16:0/2534793632 conn(0x7f483c06db90 msgr2=0x7f483c06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:10.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 -- 172.21.15.16:0/2534793632 shutdown_connections 2024-04-17T15:10:10.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.135+0000 7f4843000640 1 -- 172.21.15.16:0/2534793632 wait complete. 2024-04-17T15:10:10.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 Processor -- start 2024-04-17T15:10:10.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 -- start start 2024-04-17T15:10:10.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240039f0 0x7f483c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f483c14d740 0x7f483c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f483c0c86d0 con 0x7f483c14e2e0 2024-04-17T15:10:10.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f483c1551b0 con 0x7f483c14d740 2024-04-17T15:10:10.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4843000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f483c0c8850 con 0x7f48240039f0 2024-04-17T15:10:10.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4841200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4841200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33714/0 (socket says 172.21.15.16:33714) 2024-04-17T15:10:10.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.139+0000 7f4841200640 1 -- 172.21.15.16:0/1441388146 learned_addr learned my addr 172.21.15.16:0/1441388146 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:10.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841c00640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240039f0 0x7f483c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4842600640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f483c14d740 0x7f483c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841200640 1 -- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240039f0 msgr2=0x7f483c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841200640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240039f0 0x7f483c15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841200640 1 -- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f483c14d740 msgr2=0x7f483c14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841200640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f483c14d740 0x7f483c14dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.143+0000 7f4841200640 1 -- 172.21.15.16:0/1441388146 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c150f50 con 0x7f483c14e2e0 2024-04-17T15:10:10.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.147+0000 7f4841200640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f482800c870 tx=0x7f482800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:10.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828018070 con 0x7f483c14e2e0 2024-04-17T15:10:10.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48280074e0 con 0x7f483c14e2e0 2024-04-17T15:10:10.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828004a30 con 0x7f483c14e2e0 2024-04-17T15:10:10.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c1f7f00 con 0x7f483c14e2e0 2024-04-17T15:10:10.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c151210 con 0x7f483c14e2e0 2024-04-17T15:10:10.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.151+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c0761a0 con 0x7f483c14e2e0 2024-04-17T15:10:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.175+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f482801b070 con 0x7f483c14e2e0 2024-04-17T15:10:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.175+0000 7f4839600640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 0x7f481c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.175+0000 7f4841c00640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 0x7f481c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.175+0000 7f4841c00640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 0x7f481c06a8c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f48300046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:10.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.179+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4828001cd0 con 0x7f483c14e2e0 2024-04-17T15:10:10.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.435+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4828022020 con 0x7f483c14e2e0 2024-04-17T15:10:10.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.599+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f483c14e100 con 0x7f481c068400 2024-04-17T15:10:10.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.623+0000 7f4839600640 1 -- 172.21.15.16:0/1441388146 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253037 (secure 0 0 0) 0x7f4830009730 con 0x7f481c068400 2024-04-17T15:10:10.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:10.628 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T15:10:10.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 msgr2=0x7f481c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 0x7f481c06a8c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f48300046d0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 msgr2=0x7f483c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f482800c870 tx=0x7f482800cd30 comp rx=0 tx=0).stop 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 shutdown_connections 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f481c068400 0x7f481c06a8c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f483c14d740 0x7f483c14dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f483c14e2e0 0x7f483c0c61a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 --2- 172.21.15.16:0/1441388146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48240039f0 0x7f483c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 >> 172.21.15.16:0/1441388146 conn(0x7f483c06db90 msgr2=0x7f483c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:10.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 shutdown_connections 2024-04-17T15:10:10.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.627+0000 7f4843000640 1 -- 172.21.15.16:0/1441388146 wait complete. 2024-04-17T15:10:10.645 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":946,"stamp":"2024-04-17T15:10:09.715646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39264798,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1257,"num_read_kb":137983,"num_write":14341,"num_write_kb":371145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13471,"ondisk_log_size":13471,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":348984,"kb_used_data":78776,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754625736,"statfs":{"total":773094113280,"available":772736753664,"internally_reserved":0,"allocated":80666624,"data_stored":79285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":155202,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":54,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004792"},"pg_stats":[{"pgid":"3.3f","version":"25'55","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158881+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T15:09:32.158881+0000","last_peered":"2024-04-17T15:09:32.158881+0000","last_clean":"2024-04-17T15:09:32.158881+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T15:09:32.158881+0000","last_undegraded":"2024-04-17T15:09:32.158881+0000","last_fullsized":"2024-04-17T15:09:32.158881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":45,"num_write_kb":3409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'69","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:11.677273+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T15:09:11.677273+0000","last_peered":"2024-04-17T15:09:11.677273+0000","last_clean":"2024-04-17T15:09:11.677273+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T15:09:11.677273+0000","last_undegraded":"2024-04-17T15:09:11.677273+0000","last_fullsized":"2024-04-17T15:09:11.677273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":60,"num_write_kb":3465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'77","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.150829+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T15:09:30.150829+0000","last_peered":"2024-04-17T15:09:30.150829+0000","last_clean":"2024-04-17T15:09:30.150829+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T15:09:30.150829+0000","last_undegraded":"2024-04-17T15:09:30.150829+0000","last_fullsized":"2024-04-17T15:09:30.150829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":2861,"num_write":63,"num_write_kb":6749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'48","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.419606+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T15:09:36.419606+0000","last_peered":"2024-04-17T15:09:36.419606+0000","last_clean":"2024-04-17T15:09:36.419606+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T15:09:36.419606+0000","last_undegraded":"2024-04-17T15:09:36.419606+0000","last_fullsized":"2024-04-17T15:09:36.419606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'94","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.983411+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T15:09:29.983411+0000","last_peered":"2024-04-17T15:09:29.983411+0000","last_clean":"2024-04-17T15:09:29.983411+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T15:09:29.983411+0000","last_undegraded":"2024-04-17T15:09:29.983411+0000","last_fullsized":"2024-04-17T15:09:29.983411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2548,"num_write":80,"num_write_kb":4150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'92","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.151778+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T15:09:09.151778+0000","last_peered":"2024-04-17T15:09:09.151778+0000","last_clean":"2024-04-17T15:09:09.151778+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T15:09:09.151778+0000","last_undegraded":"2024-04-17T15:09:09.151778+0000","last_fullsized":"2024-04-17T15:09:09.151778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":80,"num_write_kb":2528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'96","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.336862+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T15:09:32.336862+0000","last_peered":"2024-04-17T15:09:32.336862+0000","last_clean":"2024-04-17T15:09:32.336862+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T15:09:32.336862+0000","last_undegraded":"2024-04-17T15:09:32.336862+0000","last_fullsized":"2024-04-17T15:09:32.336862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":86,"num_write_kb":7600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'70","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.351217+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T15:09:36.351217+0000","last_peered":"2024-04-17T15:09:36.351217+0000","last_clean":"2024-04-17T15:09:36.351217+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T15:09:36.351217+0000","last_undegraded":"2024-04-17T15:09:36.351217+0000","last_fullsized":"2024-04-17T15:09:36.351217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1525,"num_write":67,"num_write_kb":3989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'77","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608023+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T15:09:32.608023+0000","last_peered":"2024-04-17T15:09:32.608023+0000","last_clean":"2024-04-17T15:09:32.608023+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T15:09:32.608023+0000","last_undegraded":"2024-04-17T15:09:32.608023+0000","last_fullsized":"2024-04-17T15:09:32.608023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":58,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.354385+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T15:09:13.354385+0000","last_peered":"2024-04-17T15:09:13.354385+0000","last_clean":"2024-04-17T15:09:13.354385+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T15:09:13.354385+0000","last_undegraded":"2024-04-17T15:09:13.354385+0000","last_fullsized":"2024-04-17T15:09:13.354385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":61,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'84","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:03.720201+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T15:09:03.720201+0000","last_peered":"2024-04-17T15:09:03.720201+0000","last_clean":"2024-04-17T15:09:03.720201+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T15:09:03.720201+0000","last_undegraded":"2024-04-17T15:09:03.720201+0000","last_fullsized":"2024-04-17T15:09:03.720201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":68,"num_write_kb":6389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'54","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.043518+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T15:09:09.043518+0000","last_peered":"2024-04-17T15:09:09.043518+0000","last_clean":"2024-04-17T15:09:09.043518+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T15:09:09.043518+0000","last_undegraded":"2024-04-17T15:09:09.043518+0000","last_fullsized":"2024-04-17T15:09:09.043518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":46,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'54","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.355878+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T15:09:32.355878+0000","last_peered":"2024-04-17T15:09:32.355878+0000","last_clean":"2024-04-17T15:09:32.355878+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T15:09:32.355878+0000","last_undegraded":"2024-04-17T15:09:32.355878+0000","last_fullsized":"2024-04-17T15:09:32.355878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'79","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.101323+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T15:09:32.101323+0000","last_peered":"2024-04-17T15:09:32.101323+0000","last_clean":"2024-04-17T15:09:32.101323+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T15:09:32.101323+0000","last_undegraded":"2024-04-17T15:09:32.101323+0000","last_fullsized":"2024-04-17T15:09:32.101323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":67,"num_write_kb":3643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'81","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.528532+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T15:09:32.528532+0000","last_peered":"2024-04-17T15:09:32.528532+0000","last_clean":"2024-04-17T15:09:32.528532+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T15:09:32.528532+0000","last_undegraded":"2024-04-17T15:09:32.528532+0000","last_fullsized":"2024-04-17T15:09:32.528532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6351,"num_write":71,"num_write_kb":4827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'88","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078248+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T15:09:32.078248+0000","last_peered":"2024-04-17T15:09:32.078248+0000","last_clean":"2024-04-17T15:09:32.078248+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T15:09:32.078248+0000","last_undegraded":"2024-04-17T15:09:32.078248+0000","last_fullsized":"2024-04-17T15:09:32.078248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2606,"num_write":80,"num_write_kb":5984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353369+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T15:08:49.353369+0000","last_peered":"2024-04-17T15:08:49.353369+0000","last_clean":"2024-04-17T15:08:49.353369+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T15:08:49.353369+0000","last_undegraded":"2024-04-17T15:08:49.353369+0000","last_fullsized":"2024-04-17T15:08:49.353369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":64,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'82","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.133194+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T15:09:30.133194+0000","last_peered":"2024-04-17T15:09:30.133194+0000","last_clean":"2024-04-17T15:09:30.133194+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T15:09:30.133194+0000","last_undegraded":"2024-04-17T15:09:30.133194+0000","last_fullsized":"2024-04-17T15:09:30.133194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":64,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'67","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.140239+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T15:09:30.140239+0000","last_peered":"2024-04-17T15:09:30.140239+0000","last_clean":"2024-04-17T15:09:30.140239+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T15:09:30.140239+0000","last_undegraded":"2024-04-17T15:09:30.140239+0000","last_fullsized":"2024-04-17T15:09:30.140239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":51,"num_write_kb":3336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'105","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158895+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T15:09:32.158895+0000","last_peered":"2024-04-17T15:09:32.158895+0000","last_clean":"2024-04-17T15:09:32.158895+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T15:09:32.158895+0000","last_undegraded":"2024-04-17T15:09:32.158895+0000","last_fullsized":"2024-04-17T15:09:32.158895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":94,"num_write_kb":5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'96","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.301698+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T15:09:32.301698+0000","last_peered":"2024-04-17T15:09:32.301698+0000","last_clean":"2024-04-17T15:09:32.301698+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T15:09:32.301698+0000","last_undegraded":"2024-04-17T15:09:32.301698+0000","last_fullsized":"2024-04-17T15:09:32.301698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":82,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'73","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.897747+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T15:09:13.897747+0000","last_peered":"2024-04-17T15:09:13.897747+0000","last_clean":"2024-04-17T15:09:13.897747+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T15:09:13.897747+0000","last_undegraded":"2024-04-17T15:09:13.897747+0000","last_fullsized":"2024-04-17T15:09:13.897747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":63,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'72","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244648+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T15:09:32.244648+0000","last_peered":"2024-04-17T15:09:32.244648+0000","last_clean":"2024-04-17T15:09:32.244648+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T15:09:32.244648+0000","last_undegraded":"2024-04-17T15:09:32.244648+0000","last_fullsized":"2024-04-17T15:09:32.244648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":54,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.963165+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T15:09:29.963165+0000","last_peered":"2024-04-17T15:09:29.963165+0000","last_clean":"2024-04-17T15:09:29.963165+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T15:09:29.963165+0000","last_undegraded":"2024-04-17T15:09:29.963165+0000","last_fullsized":"2024-04-17T15:09:29.963165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":45,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'88","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.271782+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T15:09:23.271782+0000","last_peered":"2024-04-17T15:09:23.271782+0000","last_clean":"2024-04-17T15:09:23.271782+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T15:09:23.271782+0000","last_undegraded":"2024-04-17T15:09:23.271782+0000","last_fullsized":"2024-04-17T15:09:23.271782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":81,"num_write_kb":3963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'78","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.150904+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T15:09:09.150904+0000","last_peered":"2024-04-17T15:09:09.150904+0000","last_clean":"2024-04-17T15:09:09.150904+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T15:09:09.150904+0000","last_undegraded":"2024-04-17T15:09:09.150904+0000","last_fullsized":"2024-04-17T15:09:09.150904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":63,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'119","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.356705+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T15:09:32.356705+0000","last_peered":"2024-04-17T15:09:32.356705+0000","last_clean":"2024-04-17T15:09:32.356705+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T15:09:32.356705+0000","last_undegraded":"2024-04-17T15:09:32.356705+0000","last_fullsized":"2024-04-17T15:09:32.356705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":109,"num_write_kb":10749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'55","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795783+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T15:09:17.795783+0000","last_peered":"2024-04-17T15:09:17.795783+0000","last_clean":"2024-04-17T15:09:17.795783+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T15:09:17.795783+0000","last_undegraded":"2024-04-17T15:09:17.795783+0000","last_fullsized":"2024-04-17T15:09:17.795783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2802,"num_write":38,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:21.535684+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T15:09:21.535684+0000","last_peered":"2024-04-17T15:09:21.535684+0000","last_clean":"2024-04-17T15:09:21.535684+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T15:09:21.535684+0000","last_undegraded":"2024-04-17T15:09:21.535684+0000","last_fullsized":"2024-04-17T15:09:21.535684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":55,"num_write_kb":3974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'145","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.927590+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T15:09:29.927590+0000","last_peered":"2024-04-17T15:09:29.927590+0000","last_clean":"2024-04-17T15:09:29.927590+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T15:09:29.927590+0000","last_undegraded":"2024-04-17T15:09:29.927590+0000","last_fullsized":"2024-04-17T15:09:29.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":133,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'86","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.407804+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T15:09:32.407804+0000","last_peered":"2024-04-17T15:09:32.407804+0000","last_clean":"2024-04-17T15:09:32.407804+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T15:09:32.407804+0000","last_undegraded":"2024-04-17T15:09:32.407804+0000","last_fullsized":"2024-04-17T15:09:32.407804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3049,"num_write":71,"num_write_kb":6543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.404890+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T15:09:32.404890+0000","last_peered":"2024-04-17T15:09:32.404890+0000","last_clean":"2024-04-17T15:09:32.404890+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T15:09:32.404890+0000","last_undegraded":"2024-04-17T15:09:32.404890+0000","last_fullsized":"2024-04-17T15:09:32.404890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":57,"num_write_kb":6003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.157699+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T15:09:32.157699+0000","last_peered":"2024-04-17T15:09:32.157699+0000","last_clean":"2024-04-17T15:09:32.157699+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T15:09:32.157699+0000","last_undegraded":"2024-04-17T15:09:32.157699+0000","last_fullsized":"2024-04-17T15:09:32.157699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":59,"num_write_kb":5350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'768","reported_seq":800,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.541856+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T15:10:01.541856+0000","last_peered":"2024-04-17T15:10:01.541856+0000","last_clean":"2024-04-17T15:10:01.541856+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T15:10:01.541856+0000","last_undegraded":"2024-04-17T15:10:01.541856+0000","last_fullsized":"2024-04-17T15:10:01.541856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.372991+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T15:09:36.372991+0000","last_peered":"2024-04-17T15:09:36.372991+0000","last_clean":"2024-04-17T15:09:36.372991+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T15:09:36.372991+0000","last_undegraded":"2024-04-17T15:09:36.372991+0000","last_fullsized":"2024-04-17T15:09:36.372991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2033,"num_write":68,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'541","reported_seq":573,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.089549+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T15:09:57.089549+0000","last_peered":"2024-04-17T15:09:57.089549+0000","last_clean":"2024-04-17T15:09:57.089549+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T15:09:57.089549+0000","last_undegraded":"2024-04-17T15:09:57.089549+0000","last_fullsized":"2024-04-17T15:09:57.089549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'6","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807877+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T15:09:51.807877+0000","last_peered":"2024-04-17T15:09:51.807877+0000","last_clean":"2024-04-17T15:09:51.807877+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T15:09:51.807877+0000","last_undegraded":"2024-04-17T15:09:51.807877+0000","last_fullsized":"2024-04-17T15:09:51.807877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.529371+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T15:09:32.529371+0000","last_peered":"2024-04-17T15:09:32.529371+0000","last_clean":"2024-04-17T15:09:32.529371+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T15:09:32.529371+0000","last_undegraded":"2024-04-17T15:09:32.529371+0000","last_fullsized":"2024-04-17T15:09:32.529371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":71,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.696010+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T15:08:58.696010+0000","last_peered":"2024-04-17T15:08:58.696010+0000","last_clean":"2024-04-17T15:08:58.696010+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T15:08:58.696010+0000","last_undegraded":"2024-04-17T15:08:58.696010+0000","last_fullsized":"2024-04-17T15:08:58.696010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'74","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.178722+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T15:09:13.178722+0000","last_peered":"2024-04-17T15:09:13.178722+0000","last_clean":"2024-04-17T15:09:13.178722+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T15:09:13.178722+0000","last_undegraded":"2024-04-17T15:09:13.178722+0000","last_fullsized":"2024-04-17T15:09:13.178722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":63,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.896466+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T15:08:58.896466+0000","last_peered":"2024-04-17T15:08:58.896466+0000","last_clean":"2024-04-17T15:08:58.896466+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T15:08:58.896466+0000","last_undegraded":"2024-04-17T15:08:58.896466+0000","last_fullsized":"2024-04-17T15:08:58.896466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.238470+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T15:09:32.238470+0000","last_peered":"2024-04-17T15:09:32.238470+0000","last_clean":"2024-04-17T15:09:32.238470+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T15:09:32.238470+0000","last_undegraded":"2024-04-17T15:09:32.238470+0000","last_fullsized":"2024-04-17T15:09:32.238470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1337,"num_write":72,"num_write_kb":6000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'3","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.636328+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T15:09:41.636328+0000","last_peered":"2024-04-17T15:09:41.636328+0000","last_clean":"2024-04-17T15:09:41.636328+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T15:09:41.636328+0000","last_undegraded":"2024-04-17T15:09:41.636328+0000","last_fullsized":"2024-04-17T15:09:41.636328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'75","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244057+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T15:09:32.244057+0000","last_peered":"2024-04-17T15:09:32.244057+0000","last_clean":"2024-04-17T15:09:32.244057+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T15:09:32.244057+0000","last_undegraded":"2024-04-17T15:09:32.244057+0000","last_fullsized":"2024-04-17T15:09:32.244057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":59,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'391","reported_seq":423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.585352+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T15:10:01.585352+0000","last_peered":"2024-04-17T15:10:01.585352+0000","last_clean":"2024-04-17T15:10:01.585352+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T15:10:01.585352+0000","last_undegraded":"2024-04-17T15:10:01.585352+0000","last_fullsized":"2024-04-17T15:10:01.585352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'73","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078004+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T15:09:32.078004+0000","last_peered":"2024-04-17T15:09:32.078004+0000","last_clean":"2024-04-17T15:09:32.078004+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T15:09:32.078004+0000","last_undegraded":"2024-04-17T15:09:32.078004+0000","last_fullsized":"2024-04-17T15:09:32.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":63,"num_write_kb":3236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'925","reported_seq":957,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301326+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T15:10:04.301326+0000","last_peered":"2024-04-17T15:10:04.301326+0000","last_clean":"2024-04-17T15:10:04.301326+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T15:10:04.301326+0000","last_undegraded":"2024-04-17T15:10:04.301326+0000","last_fullsized":"2024-04-17T15:10:04.301326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":4530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'79","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.090178+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T15:09:30.090178+0000","last_peered":"2024-04-17T15:09:30.090178+0000","last_clean":"2024-04-17T15:09:30.090178+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T15:09:30.090178+0000","last_undegraded":"2024-04-17T15:09:30.090178+0000","last_fullsized":"2024-04-17T15:09:30.090178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":66,"num_write_kb":2869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'63","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301348+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T15:10:04.301348+0000","last_peered":"2024-04-17T15:10:04.301348+0000","last_clean":"2024-04-17T15:10:04.301348+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T15:10:04.301348+0000","last_undegraded":"2024-04-17T15:10:04.301348+0000","last_fullsized":"2024-04-17T15:10:04.301348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680040,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'76","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.153660+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T15:09:30.153660+0000","last_peered":"2024-04-17T15:09:30.153660+0000","last_clean":"2024-04-17T15:09:30.153660+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T15:09:30.153660+0000","last_undegraded":"2024-04-17T15:09:30.153660+0000","last_fullsized":"2024-04-17T15:09:30.153660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1082,"num_write":62,"num_write_kb":6883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'8","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.747281+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T15:10:06.747281+0000","last_peered":"2024-04-17T15:10:06.747281+0000","last_clean":"2024-04-17T15:10:06.747281+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T15:10:06.747281+0000","last_undegraded":"2024-04-17T15:10:06.747281+0000","last_fullsized":"2024-04-17T15:10:06.747281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'103","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608652+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T15:09:32.608652+0000","last_peered":"2024-04-17T15:09:32.608652+0000","last_clean":"2024-04-17T15:09:32.608652+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T15:09:32.608652+0000","last_undegraded":"2024-04-17T15:09:32.608652+0000","last_fullsized":"2024-04-17T15:09:32.608652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:47.607063+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T15:09:47.607063+0000","last_peered":"2024-04-17T15:09:47.607063+0000","last_clean":"2024-04-17T15:09:47.607063+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T15:09:47.607063+0000","last_undegraded":"2024-04-17T15:09:47.607063+0000","last_fullsized":"2024-04-17T15:09:47.607063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.156988+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T15:09:32.156988+0000","last_peered":"2024-04-17T15:09:32.156988+0000","last_clean":"2024-04-17T15:09:32.156988+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T15:09:32.156988+0000","last_undegraded":"2024-04-17T15:09:32.156988+0000","last_fullsized":"2024-04-17T15:09:32.156988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":55,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626072+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T15:09:41.626072+0000","last_peered":"2024-04-17T15:09:41.626072+0000","last_clean":"2024-04-17T15:09:41.626072+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T15:09:41.626072+0000","last_undegraded":"2024-04-17T15:09:41.626072+0000","last_fullsized":"2024-04-17T15:09:41.626072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.259115+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T15:09:13.259115+0000","last_peered":"2024-04-17T15:09:13.259115+0000","last_clean":"2024-04-17T15:09:13.259115+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T15:09:13.259115+0000","last_undegraded":"2024-04-17T15:09:13.259115+0000","last_fullsized":"2024-04-17T15:09:13.259115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3310,"num_write":61,"num_write_kb":6412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:56.950030+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T15:09:56.950030+0000","last_peered":"2024-04-17T15:09:56.950030+0000","last_clean":"2024-04-17T15:09:56.950030+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T15:09:56.950030+0000","last_undegraded":"2024-04-17T15:09:56.950030+0000","last_fullsized":"2024-04-17T15:09:56.950030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'40","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.108126+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T15:09:13.108126+0000","last_peered":"2024-04-17T15:09:13.108126+0000","last_clean":"2024-04-17T15:09:13.108126+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T15:09:13.108126+0000","last_undegraded":"2024-04-17T15:09:13.108126+0000","last_fullsized":"2024-04-17T15:09:13.108126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":33,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.693051+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T15:09:13.693051+0000","last_peered":"2024-04-17T15:09:13.693051+0000","last_clean":"2024-04-17T15:09:13.693051+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T15:09:13.693051+0000","last_undegraded":"2024-04-17T15:09:13.693051+0000","last_fullsized":"2024-04-17T15:09:13.693051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'60","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:43.557898+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T15:08:43.557898+0000","last_peered":"2024-04-17T15:08:43.557898+0000","last_clean":"2024-04-17T15:08:43.557898+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T15:08:43.557898+0000","last_undegraded":"2024-04-17T15:08:43.557898+0000","last_fullsized":"2024-04-17T15:08:43.557898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":47,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'4","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.784425+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T15:09:51.784425+0000","last_peered":"2024-04-17T15:09:51.784425+0000","last_clean":"2024-04-17T15:09:51.784425+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T15:09:51.784425+0000","last_undegraded":"2024-04-17T15:09:51.784425+0000","last_fullsized":"2024-04-17T15:09:51.784425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'88","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.583653+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T15:09:32.583653+0000","last_peered":"2024-04-17T15:09:32.583653+0000","last_clean":"2024-04-17T15:09:32.583653+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T15:09:32.583653+0000","last_undegraded":"2024-04-17T15:09:32.583653+0000","last_fullsized":"2024-04-17T15:09:32.583653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":1779,"num_write":77,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807444+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T15:09:51.807444+0000","last_peered":"2024-04-17T15:09:51.807444+0000","last_clean":"2024-04-17T15:09:51.807444+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T15:09:51.807444+0000","last_undegraded":"2024-04-17T15:09:51.807444+0000","last_fullsized":"2024-04-17T15:09:51.807444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353180+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T15:08:49.353180+0000","last_peered":"2024-04-17T15:08:49.353180+0000","last_clean":"2024-04-17T15:08:49.353180+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T15:08:49.353180+0000","last_undegraded":"2024-04-17T15:08:49.353180+0000","last_fullsized":"2024-04-17T15:08:49.353180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":68,"num_write_kb":2018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:07:23.887226+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T15:07:23.887226+0000","last_peered":"2024-04-17T15:07:23.887226+0000","last_clean":"2024-04-17T15:07:23.887226+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T15:07:23.887226+0000","last_undegraded":"2024-04-17T15:07:23.887226+0000","last_fullsized":"2024-04-17T15:07:23.887226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'7","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652462+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T15:10:01.652462+0000","last_peered":"2024-04-17T15:10:01.652462+0000","last_clean":"2024-04-17T15:10:01.652462+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T15:10:01.652462+0000","last_undegraded":"2024-04-17T15:10:01.652462+0000","last_fullsized":"2024-04-17T15:10:01.652462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:38.539265+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T15:08:38.539265+0000","last_peered":"2024-04-17T15:08:38.539265+0000","last_clean":"2024-04-17T15:08:38.539265+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T15:08:38.539265+0000","last_undegraded":"2024-04-17T15:08:38.539265+0000","last_fullsized":"2024-04-17T15:08:38.539265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2040,"num_write":75,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'211","reported_seq":246,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.097540+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T15:09:57.097540+0000","last_peered":"2024-04-17T15:09:57.097540+0000","last_clean":"2024-04-17T15:09:57.097540+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T15:09:57.097540+0000","last_undegraded":"2024-04-17T15:09:57.097540+0000","last_fullsized":"2024-04-17T15:09:57.097540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'80","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795863+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T15:09:17.795863+0000","last_peered":"2024-04-17T15:09:17.795863+0000","last_clean":"2024-04-17T15:09:17.795863+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T15:09:17.795863+0000","last_undegraded":"2024-04-17T15:09:17.795863+0000","last_fullsized":"2024-04-17T15:09:17.795863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":73,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'621","reported_seq":1270,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.543365+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T15:10:01.543365+0000","last_peered":"2024-04-17T15:10:01.543365+0000","last_clean":"2024-04-17T15:10:01.543365+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T15:10:01.543365+0000","last_undegraded":"2024-04-17T15:10:01.543365+0000","last_fullsized":"2024-04-17T15:10:01.543365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244218,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":617,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'63","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.245350+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T15:09:32.245350+0000","last_peered":"2024-04-17T15:09:32.245350+0000","last_clean":"2024-04-17T15:09:32.245350+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T15:09:32.245350+0000","last_undegraded":"2024-04-17T15:09:32.245350+0000","last_fullsized":"2024-04-17T15:09:32.245350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":53,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.718195+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T15:10:06.718195+0000","last_peered":"2024-04-17T15:10:06.718195+0000","last_clean":"2024-04-17T15:10:06.718195+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T15:10:06.718195+0000","last_undegraded":"2024-04-17T15:10:06.718195+0000","last_fullsized":"2024-04-17T15:10:06.718195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'57","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.104672+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T15:09:32.104672+0000","last_peered":"2024-04-17T15:09:32.104672+0000","last_clean":"2024-04-17T15:09:32.104672+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T15:09:32.104672+0000","last_undegraded":"2024-04-17T15:09:32.104672+0000","last_fullsized":"2024-04-17T15:09:32.104672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":47,"num_write_kb":3555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.785304+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T15:09:51.785304+0000","last_peered":"2024-04-17T15:09:51.785304+0000","last_clean":"2024-04-17T15:09:51.785304+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T15:09:51.785304+0000","last_undegraded":"2024-04-17T15:09:51.785304+0000","last_fullsized":"2024-04-17T15:09:51.785304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'76","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:08.815706+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T15:09:08.815706+0000","last_peered":"2024-04-17T15:09:08.815706+0000","last_clean":"2024-04-17T15:09:08.815706+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T15:09:08.815706+0000","last_undegraded":"2024-04-17T15:09:08.815706+0000","last_fullsized":"2024-04-17T15:09:08.815706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":66,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.651305+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T15:10:01.651305+0000","last_peered":"2024-04-17T15:10:01.651305+0000","last_clean":"2024-04-17T15:10:01.651305+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T15:10:01.651305+0000","last_undegraded":"2024-04-17T15:10:01.651305+0000","last_fullsized":"2024-04-17T15:10:01.651305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'76","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.019032+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T15:09:09.019032+0000","last_peered":"2024-04-17T15:09:09.019032+0000","last_clean":"2024-04-17T15:09:09.019032+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T15:09:09.019032+0000","last_undegraded":"2024-04-17T15:09:09.019032+0000","last_fullsized":"2024-04-17T15:09:09.019032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":61,"num_write_kb":2647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1175","reported_seq":1208,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.857741+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T15:10:04.857741+0000","last_peered":"2024-04-17T15:10:04.857741+0000","last_clean":"2024-04-17T15:10:04.857741+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T15:10:04.857741+0000","last_undegraded":"2024-04-17T15:10:04.857741+0000","last_fullsized":"2024-04-17T15:10:04.857741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2894,"num_write_kb":1176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'85","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.299288+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T15:09:32.299288+0000","last_peered":"2024-04-17T15:09:32.299288+0000","last_clean":"2024-04-17T15:09:32.299288+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T15:09:32.299288+0000","last_undegraded":"2024-04-17T15:09:32.299288+0000","last_fullsized":"2024-04-17T15:09:32.299288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3434,"num_write":74,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'9","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.650974+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T15:10:01.650974+0000","last_peered":"2024-04-17T15:10:01.650974+0000","last_clean":"2024-04-17T15:10:01.650974+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T15:10:01.650974+0000","last_undegraded":"2024-04-17T15:10:01.650974+0000","last_fullsized":"2024-04-17T15:10:01.650974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.212615+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T15:09:30.212615+0000","last_peered":"2024-04-17T15:09:30.212615+0000","last_clean":"2024-04-17T15:09:30.212615+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T15:09:30.212615+0000","last_undegraded":"2024-04-17T15:09:30.212615+0000","last_fullsized":"2024-04-17T15:09:30.212615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":52,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.647588+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T15:10:01.647588+0000","last_peered":"2024-04-17T15:10:01.647588+0000","last_clean":"2024-04-17T15:10:01.647588+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T15:10:01.647588+0000","last_undegraded":"2024-04-17T15:10:01.647588+0000","last_fullsized":"2024-04-17T15:10:01.647588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'98","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.068750+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T15:09:23.068750+0000","last_peered":"2024-04-17T15:09:23.068750+0000","last_clean":"2024-04-17T15:09:23.068750+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T15:09:23.068750+0000","last_undegraded":"2024-04-17T15:09:23.068750+0000","last_fullsized":"2024-04-17T15:09:23.068750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2098,"num_write":85,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'6","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.813018+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T15:09:51.813018+0000","last_peered":"2024-04-17T15:09:51.813018+0000","last_clean":"2024-04-17T15:09:51.813018+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T15:09:51.813018+0000","last_undegraded":"2024-04-17T15:09:51.813018+0000","last_fullsized":"2024-04-17T15:09:51.813018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'63","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.300278+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T15:09:32.300278+0000","last_peered":"2024-04-17T15:09:32.300278+0000","last_clean":"2024-04-17T15:09:32.300278+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T15:09:32.300278+0000","last_undegraded":"2024-04-17T15:09:32.300278+0000","last_fullsized":"2024-04-17T15:09:32.300278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":50,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'2","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807732+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T15:09:51.807732+0000","last_peered":"2024-04-17T15:09:51.807732+0000","last_clean":"2024-04-17T15:09:51.807732+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T15:09:51.807732+0000","last_undegraded":"2024-04-17T15:09:51.807732+0000","last_fullsized":"2024-04-17T15:09:51.807732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'75","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.911205+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T15:09:29.911205+0000","last_peered":"2024-04-17T15:09:29.911205+0000","last_clean":"2024-04-17T15:09:29.911205+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T15:09:29.911205+0000","last_undegraded":"2024-04-17T15:09:29.911205+0000","last_fullsized":"2024-04-17T15:09:29.911205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":67,"num_write_kb":4068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'778","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652042+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T15:10:01.652042+0000","last_peered":"2024-04-17T15:10:01.652042+0000","last_clean":"2024-04-17T15:10:01.652042+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T15:10:01.652042+0000","last_undegraded":"2024-04-17T15:10:01.652042+0000","last_fullsized":"2024-04-17T15:10:01.652042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'119","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.926443+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T15:09:29.926443+0000","last_peered":"2024-04-17T15:09:29.926443+0000","last_clean":"2024-04-17T15:09:29.926443+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T15:09:29.926443+0000","last_undegraded":"2024-04-17T15:09:29.926443+0000","last_fullsized":"2024-04-17T15:09:29.926443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":110,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.066946+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T15:09:23.066946+0000","last_peered":"2024-04-17T15:09:23.066946+0000","last_clean":"2024-04-17T15:09:23.066946+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T15:09:23.066946+0000","last_undegraded":"2024-04-17T15:09:23.066946+0000","last_fullsized":"2024-04-17T15:09:23.066946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2294,"num_write":58,"num_write_kb":5884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.085826+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T15:09:57.085826+0000","last_peered":"2024-04-17T15:09:57.085826+0000","last_clean":"2024-04-17T15:09:57.085826+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T15:09:57.085826+0000","last_undegraded":"2024-04-17T15:09:57.085826+0000","last_fullsized":"2024-04-17T15:09:57.085826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'62","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.353652+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T15:09:36.353652+0000","last_peered":"2024-04-17T15:09:36.353652+0000","last_clean":"2024-04-17T15:09:36.353652+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T15:09:36.353652+0000","last_undegraded":"2024-04-17T15:09:36.353652+0000","last_fullsized":"2024-04-17T15:09:36.353652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":47,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1266","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.648803+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T15:10:01.648803+0000","last_peered":"2024-04-17T15:10:01.648803+0000","last_clean":"2024-04-17T15:10:01.648803+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T15:10:01.648803+0000","last_undegraded":"2024-04-17T15:10:01.648803+0000","last_fullsized":"2024-04-17T15:10:01.648803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":8829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'116","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:34.452732+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T15:08:34.452732+0000","last_peered":"2024-04-17T15:08:34.452732+0000","last_clean":"2024-04-17T15:08:34.452732+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T15:08:34.452732+0000","last_undegraded":"2024-04-17T15:08:34.452732+0000","last_fullsized":"2024-04-17T15:08:34.452732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":107,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'779","reported_seq":813,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.740693+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T15:09:41.740693+0000","last_peered":"2024-04-17T15:09:41.740693+0000","last_clean":"2024-04-17T15:09:41.740693+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T15:09:41.740693+0000","last_undegraded":"2024-04-17T15:09:41.740693+0000","last_fullsized":"2024-04-17T15:09:41.740693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'90","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.889222+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T15:09:29.889222+0000","last_peered":"2024-04-17T15:09:29.889222+0000","last_clean":"2024-04-17T15:09:29.889222+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T15:09:29.889222+0000","last_undegraded":"2024-04-17T15:09:29.889222+0000","last_fullsized":"2024-04-17T15:09:29.889222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":83,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'707","reported_seq":741,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626443+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T15:09:41.626443+0000","last_peered":"2024-04-17T15:09:41.626443+0000","last_clean":"2024-04-17T15:09:41.626443+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T15:09:41.626443+0000","last_undegraded":"2024-04-17T15:09:41.626443+0000","last_fullsized":"2024-04-17T15:09:41.626443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":137179,"num_write":4261,"num_write_kb":326145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5036,"ondisk_log_size":5036,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38674430,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":9921,"num_write_kb":42584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77422592,"data_stored":77360270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8318,"ondisk_log_size":8318,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509815,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":4452352,"data_stored":4288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":8460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":8663040,"data_stored":8484412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43656,"kb_used_data":16640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328184,"statfs":{"total":96636764160,"available":96592060416,"internally_reserved":0,"allocated":17039360,"data_stored":16872258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509814,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52108,"kb_used_data":8452,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319732,"statfs":{"total":96636764160,"available":96583405568,"internally_reserved":0,"allocated":8654848,"data_stored":8483740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509815,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48524,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323316,"statfs":{"total":96636764160,"available":96587075584,"internally_reserved":0,"allocated":9244672,"data_stored":9073506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509815,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44392,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327448,"statfs":{"total":96636764160,"available":96591306752,"internally_reserved":0,"allocated":13533184,"data_stored":13357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":5390336,"data_stored":5213112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542518,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40384,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":13688832,"data_stored":13512050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13283328,"data_stored":13274384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12836864,"data_stored":12827222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5132288,"data_stored":5118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:10:10.651 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T15:10:10.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:10:10.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 Processor -- start 2024-04-17T15:10:10.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 -- start start 2024-04-17T15:10:10.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8080152fe0 0x7f80800c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800c3640 0x7f80800ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808015c250 con 0x7f80800cf080 2024-04-17T15:10:10.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f808015d0b0 con 0x7f8080152fe0 2024-04-17T15:10:10.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f8085e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f808015c530 con 0x7f80800c3640 2024-04-17T15:10:10.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f807ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8080152fe0 0x7f80800c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f807f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f80800cf080 0x7f80800ca530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52608/0 (socket says 172.21.15.16:52608) 2024-04-17T15:10:10.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f807f400640 1 -- 172.21.15.16:0/2755798459 learned_addr learned my addr 172.21.15.16:0/2755798459 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:10.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.835+0000 7f807e000640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800c3640 0x7f80800ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.839+0000 7f807d600640 1 -- 172.21.15.16:0/2755798459 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010344692 0 0) 0x7f808015c250 con 0x7f80800cf080 2024-04-17T15:10:10.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.839+0000 7f807d600640 1 -- 172.21.15.16:0/2755798459 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003530 con 0x7f80800cf080 2024-04-17T15:10:10.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.843+0000 7f807ea00640 1 -- 172.21.15.16:0/2755798459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800c3640 msgr2=0x7f80800ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:10.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.843+0000 7f807ea00640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800c3640 0x7f80800ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.843+0000 7f807ea00640 1 -- 172.21.15.16:0/2755798459 >> v1:172.21.15.16:6789/0 conn(0x7f80800cf080 legacy=0x7f80800ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.843+0000 7f807ea00640 1 -- 172.21.15.16:0/2755798459 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808015c810 con 0x7f8080152fe0 2024-04-17T15:10:10.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.847+0000 7f807ea00640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8080152fe0 0x7f80800c9020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80700097c0 tx=0x7f807001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c860d3cb7a3951 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.847+0000 7f807d600640 1 -- 172.21.15.16:0/2755798459 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80700b0070 con 0x7f8080152fe0 2024-04-17T15:10:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.847+0000 7f807d600640 1 -- 172.21.15.16:0/2755798459 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80700ab600 con 0x7f8080152fe0 2024-04-17T15:10:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.847+0000 7f807d600640 1 -- 172.21.15.16:0/2755798459 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80700ab9d0 con 0x7f8080152fe0 2024-04-17T15:10:10.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- 172.21.15.16:0/2755798459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8080152fe0 msgr2=0x7f80800c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8080152fe0 0x7f80800c9020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80700097c0 tx=0x7f807001c4a0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- 172.21.15.16:0/2755798459 shutdown_connections 2024-04-17T15:10:10.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800c3640 0x7f80800ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- 172.21.15.16:0/2755798459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8080152fe0 0x7f80800c9020 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- 172.21.15.16:0/2755798459 >> 172.21.15.16:0/2755798459 conn(0x7f808006fb60 msgr2=0x7f808006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:10.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- 172.21.15.16:0/2755798459 shutdown_connections 2024-04-17T15:10:10.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- 172.21.15.16:0/2755798459 wait complete. 2024-04-17T15:10:10.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 Processor -- start 2024-04-17T15:10:10.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- start start 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800cf080 0x7f80801f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 0x7f80800c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80800c4be0 con 0x7f80800c3640 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f80800c4a60 con 0x7f8080152fe0 2024-04-17T15:10:10.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.851+0000 7f8085e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f8080165cf0 con 0x7f80800cf080 2024-04-17T15:10:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.855+0000 7f807ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.855+0000 7f807ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33730/0 (socket says 172.21.15.16:33730) 2024-04-17T15:10:10.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.855+0000 7f807ea00640 1 -- 172.21.15.16:0/3866777562 learned_addr learned my addr 172.21.15.16:0/3866777562 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:10.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.855+0000 7f807f400640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 0x7f80800c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.855+0000 7f807e000640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800cf080 0x7f80801f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:10.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 -- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800cf080 msgr2=0x7f80801f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800cf080 0x7f80801f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 -- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 msgr2=0x7f80800c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:10.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 0x7f80800c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:10.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 -- 172.21.15.16:0/3866777562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80801f4680 con 0x7f80800c3640 2024-04-17T15:10:10.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807f400640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 0x7f80800c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T15:10:10.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.859+0000 7f807ea00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f807001a0d0 tx=0x7f8070019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80700b0040 con 0x7f80800c3640 2024-04-17T15:10:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80700ba070 con 0x7f80800c3640 2024-04-17T15:10:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070006e20 con 0x7f80800c3640 2024-04-17T15:10:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8080159e40 con 0x7f80800c3640 2024-04-17T15:10:10.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808015a3c0 con 0x7f80800c3640 2024-04-17T15:10:10.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:10.863+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8080076280 con 0x7f80800c3640 2024-04-17T15:10:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.131+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80700b4630 con 0x7f80800c3640 2024-04-17T15:10:11.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.131+0000 7f8077400640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 0x7f806006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.131+0000 7f807e000640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 0x7f806006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.131+0000 7f807e000640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 0x7f806006a890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8080156790 tx=0x7f806c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:11.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.143+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f80700eef70 con 0x7f80800c3640 2024-04-17T15:10:11.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.143+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8070016090 con 0x7f80800c3640 2024-04-17T15:10:11.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.307+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80800c9820 con 0x7f80600683d0 2024-04-17T15:10:11.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.323+0000 7f8077400640 1 -- 172.21.15.16:0/3866777562 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253037 (secure 0 0 0) 0x7f80800c9820 con 0x7f80600683d0 2024-04-17T15:10:11.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:11.328 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 msgr2=0x7f806006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 0x7f806006a890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8080156790 tx=0x7f806c009190 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 msgr2=0x7f808015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f807001a0d0 tx=0x7f8070019240 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 shutdown_connections 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f80600683d0 0x7f806006a890 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8080152fe0 0x7f80800c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f80800cf080 0x7f80801f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 --2- 172.21.15.16:0/3866777562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80800c3640 0x7f808015b300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 >> 172.21.15.16:0/3866777562 conn(0x7f808006fb60 msgr2=0x7f80800c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:11.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 shutdown_connections 2024-04-17T15:10:11.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.327+0000 7f8085e00640 1 -- 172.21.15.16:0/3866777562 wait complete. 2024-04-17T15:10:11.347 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":946,"stamp":"2024-04-17T15:10:09.715646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39264798,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1257,"num_read_kb":137983,"num_write":14341,"num_write_kb":371145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13471,"ondisk_log_size":13471,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":348984,"kb_used_data":78776,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754625736,"statfs":{"total":773094113280,"available":772736753664,"internally_reserved":0,"allocated":80666624,"data_stored":79285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":155202,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":54,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004792"},"pg_stats":[{"pgid":"3.3f","version":"25'55","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158881+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T15:09:32.158881+0000","last_peered":"2024-04-17T15:09:32.158881+0000","last_clean":"2024-04-17T15:09:32.158881+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T15:09:32.158881+0000","last_undegraded":"2024-04-17T15:09:32.158881+0000","last_fullsized":"2024-04-17T15:09:32.158881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":45,"num_write_kb":3409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'69","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:11.677273+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T15:09:11.677273+0000","last_peered":"2024-04-17T15:09:11.677273+0000","last_clean":"2024-04-17T15:09:11.677273+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T15:09:11.677273+0000","last_undegraded":"2024-04-17T15:09:11.677273+0000","last_fullsized":"2024-04-17T15:09:11.677273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":60,"num_write_kb":3465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'77","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.150829+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T15:09:30.150829+0000","last_peered":"2024-04-17T15:09:30.150829+0000","last_clean":"2024-04-17T15:09:30.150829+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T15:09:30.150829+0000","last_undegraded":"2024-04-17T15:09:30.150829+0000","last_fullsized":"2024-04-17T15:09:30.150829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":2861,"num_write":63,"num_write_kb":6749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'48","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.419606+0000","last_change":"2024-04-17T14:39:59.400588+0000","last_active":"2024-04-17T15:09:36.419606+0000","last_peered":"2024-04-17T15:09:36.419606+0000","last_clean":"2024-04-17T15:09:36.419606+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T15:09:36.419606+0000","last_undegraded":"2024-04-17T15:09:36.419606+0000","last_fullsized":"2024-04-17T15:09:36.419606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'94","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.983411+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T15:09:29.983411+0000","last_peered":"2024-04-17T15:09:29.983411+0000","last_clean":"2024-04-17T15:09:29.983411+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T15:09:29.983411+0000","last_undegraded":"2024-04-17T15:09:29.983411+0000","last_fullsized":"2024-04-17T15:09:29.983411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:31.775574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2548,"num_write":80,"num_write_kb":4150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'92","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.151778+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T15:09:09.151778+0000","last_peered":"2024-04-17T15:09:09.151778+0000","last_clean":"2024-04-17T15:09:09.151778+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T15:09:09.151778+0000","last_undegraded":"2024-04-17T15:09:09.151778+0000","last_fullsized":"2024-04-17T15:09:09.151778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":80,"num_write_kb":2528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'96","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.336862+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T15:09:32.336862+0000","last_peered":"2024-04-17T15:09:32.336862+0000","last_clean":"2024-04-17T15:09:32.336862+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T15:09:32.336862+0000","last_undegraded":"2024-04-17T15:09:32.336862+0000","last_fullsized":"2024-04-17T15:09:32.336862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:33.320509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":86,"num_write_kb":7600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'70","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.351217+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T15:09:36.351217+0000","last_peered":"2024-04-17T15:09:36.351217+0000","last_clean":"2024-04-17T15:09:36.351217+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T15:09:36.351217+0000","last_undegraded":"2024-04-17T15:09:36.351217+0000","last_fullsized":"2024-04-17T15:09:36.351217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1525,"num_write":67,"num_write_kb":3989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'77","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608023+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T15:09:32.608023+0000","last_peered":"2024-04-17T15:09:32.608023+0000","last_clean":"2024-04-17T15:09:32.608023+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T15:09:32.608023+0000","last_undegraded":"2024-04-17T15:09:32.608023+0000","last_fullsized":"2024-04-17T15:09:32.608023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":58,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'74","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.354385+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T15:09:13.354385+0000","last_peered":"2024-04-17T15:09:13.354385+0000","last_clean":"2024-04-17T15:09:13.354385+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T15:09:13.354385+0000","last_undegraded":"2024-04-17T15:09:13.354385+0000","last_fullsized":"2024-04-17T15:09:13.354385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":61,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'84","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:03.720201+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T15:09:03.720201+0000","last_peered":"2024-04-17T15:09:03.720201+0000","last_clean":"2024-04-17T15:09:03.720201+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T15:09:03.720201+0000","last_undegraded":"2024-04-17T15:09:03.720201+0000","last_fullsized":"2024-04-17T15:09:03.720201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":68,"num_write_kb":6389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'54","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.043518+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T15:09:09.043518+0000","last_peered":"2024-04-17T15:09:09.043518+0000","last_clean":"2024-04-17T15:09:09.043518+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T15:09:09.043518+0000","last_undegraded":"2024-04-17T15:09:09.043518+0000","last_fullsized":"2024-04-17T15:09:09.043518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":46,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'54","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.355878+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T15:09:32.355878+0000","last_peered":"2024-04-17T15:09:32.355878+0000","last_clean":"2024-04-17T15:09:32.355878+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T15:09:32.355878+0000","last_undegraded":"2024-04-17T15:09:32.355878+0000","last_fullsized":"2024-04-17T15:09:32.355878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'79","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.101323+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T15:09:32.101323+0000","last_peered":"2024-04-17T15:09:32.101323+0000","last_clean":"2024-04-17T15:09:32.101323+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T15:09:32.101323+0000","last_undegraded":"2024-04-17T15:09:32.101323+0000","last_fullsized":"2024-04-17T15:09:32.101323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":67,"num_write_kb":3643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'81","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.528532+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T15:09:32.528532+0000","last_peered":"2024-04-17T15:09:32.528532+0000","last_clean":"2024-04-17T15:09:32.528532+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T15:09:32.528532+0000","last_undegraded":"2024-04-17T15:09:32.528532+0000","last_fullsized":"2024-04-17T15:09:32.528532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6351,"num_write":71,"num_write_kb":4827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'88","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078248+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T15:09:32.078248+0000","last_peered":"2024-04-17T15:09:32.078248+0000","last_clean":"2024-04-17T15:09:32.078248+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T15:09:32.078248+0000","last_undegraded":"2024-04-17T15:09:32.078248+0000","last_fullsized":"2024-04-17T15:09:32.078248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:38.204064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2606,"num_write":80,"num_write_kb":5984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353369+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T15:08:49.353369+0000","last_peered":"2024-04-17T15:08:49.353369+0000","last_clean":"2024-04-17T15:08:49.353369+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T15:08:49.353369+0000","last_undegraded":"2024-04-17T15:08:49.353369+0000","last_fullsized":"2024-04-17T15:08:49.353369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:14.317392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":64,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'82","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.133194+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T15:09:30.133194+0000","last_peered":"2024-04-17T15:09:30.133194+0000","last_clean":"2024-04-17T15:09:30.133194+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T15:09:30.133194+0000","last_undegraded":"2024-04-17T15:09:30.133194+0000","last_fullsized":"2024-04-17T15:09:30.133194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":64,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'67","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.140239+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T15:09:30.140239+0000","last_peered":"2024-04-17T15:09:30.140239+0000","last_clean":"2024-04-17T15:09:30.140239+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T15:09:30.140239+0000","last_undegraded":"2024-04-17T15:09:30.140239+0000","last_fullsized":"2024-04-17T15:09:30.140239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:37.787746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":51,"num_write_kb":3336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'105","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.158895+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T15:09:32.158895+0000","last_peered":"2024-04-17T15:09:32.158895+0000","last_clean":"2024-04-17T15:09:32.158895+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T15:09:32.158895+0000","last_undegraded":"2024-04-17T15:09:32.158895+0000","last_fullsized":"2024-04-17T15:09:32.158895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:52:50.825986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":94,"num_write_kb":5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'96","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.301698+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T15:09:32.301698+0000","last_peered":"2024-04-17T15:09:32.301698+0000","last_clean":"2024-04-17T15:09:32.301698+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T15:09:32.301698+0000","last_undegraded":"2024-04-17T15:09:32.301698+0000","last_fullsized":"2024-04-17T15:09:32.301698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":82,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'73","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.897747+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T15:09:13.897747+0000","last_peered":"2024-04-17T15:09:13.897747+0000","last_clean":"2024-04-17T15:09:13.897747+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T15:09:13.897747+0000","last_undegraded":"2024-04-17T15:09:13.897747+0000","last_fullsized":"2024-04-17T15:09:13.897747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:11.328113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":63,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'72","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244648+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T15:09:32.244648+0000","last_peered":"2024-04-17T15:09:32.244648+0000","last_clean":"2024-04-17T15:09:32.244648+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T15:09:32.244648+0000","last_undegraded":"2024-04-17T15:09:32.244648+0000","last_fullsized":"2024-04-17T15:09:32.244648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":54,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.963165+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T15:09:29.963165+0000","last_peered":"2024-04-17T15:09:29.963165+0000","last_clean":"2024-04-17T15:09:29.963165+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T15:09:29.963165+0000","last_undegraded":"2024-04-17T15:09:29.963165+0000","last_fullsized":"2024-04-17T15:09:29.963165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:07.507583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":45,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'88","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.271782+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T15:09:23.271782+0000","last_peered":"2024-04-17T15:09:23.271782+0000","last_clean":"2024-04-17T15:09:23.271782+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T15:09:23.271782+0000","last_undegraded":"2024-04-17T15:09:23.271782+0000","last_fullsized":"2024-04-17T15:09:23.271782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":81,"num_write_kb":3963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'78","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.150904+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T15:09:09.150904+0000","last_peered":"2024-04-17T15:09:09.150904+0000","last_clean":"2024-04-17T15:09:09.150904+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T15:09:09.150904+0000","last_undegraded":"2024-04-17T15:09:09.150904+0000","last_fullsized":"2024-04-17T15:09:09.150904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":63,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'119","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.356705+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T15:09:32.356705+0000","last_peered":"2024-04-17T15:09:32.356705+0000","last_clean":"2024-04-17T15:09:32.356705+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T15:09:32.356705+0000","last_undegraded":"2024-04-17T15:09:32.356705+0000","last_fullsized":"2024-04-17T15:09:32.356705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":109,"num_write_kb":10749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'55","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795783+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T15:09:17.795783+0000","last_peered":"2024-04-17T15:09:17.795783+0000","last_clean":"2024-04-17T15:09:17.795783+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T15:09:17.795783+0000","last_undegraded":"2024-04-17T15:09:17.795783+0000","last_fullsized":"2024-04-17T15:09:17.795783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2802,"num_write":38,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'66","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:21.535684+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T15:09:21.535684+0000","last_peered":"2024-04-17T15:09:21.535684+0000","last_clean":"2024-04-17T15:09:21.535684+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T15:09:21.535684+0000","last_undegraded":"2024-04-17T15:09:21.535684+0000","last_fullsized":"2024-04-17T15:09:21.535684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":55,"num_write_kb":3974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'145","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.927590+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T15:09:29.927590+0000","last_peered":"2024-04-17T15:09:29.927590+0000","last_clean":"2024-04-17T15:09:29.927590+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T15:09:29.927590+0000","last_undegraded":"2024-04-17T15:09:29.927590+0000","last_fullsized":"2024-04-17T15:09:29.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":133,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'86","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.407804+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T15:09:32.407804+0000","last_peered":"2024-04-17T15:09:32.407804+0000","last_clean":"2024-04-17T15:09:32.407804+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T15:09:32.407804+0000","last_undegraded":"2024-04-17T15:09:32.407804+0000","last_fullsized":"2024-04-17T15:09:32.407804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3049,"num_write":71,"num_write_kb":6543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'77","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.404890+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T15:09:32.404890+0000","last_peered":"2024-04-17T15:09:32.404890+0000","last_clean":"2024-04-17T15:09:32.404890+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T15:09:32.404890+0000","last_undegraded":"2024-04-17T15:09:32.404890+0000","last_fullsized":"2024-04-17T15:09:32.404890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:09.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":57,"num_write_kb":6003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.157699+0000","last_change":"2024-04-17T14:39:59.405518+0000","last_active":"2024-04-17T15:09:32.157699+0000","last_peered":"2024-04-17T15:09:32.157699+0000","last_clean":"2024-04-17T15:09:32.157699+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T15:09:32.157699+0000","last_undegraded":"2024-04-17T15:09:32.157699+0000","last_fullsized":"2024-04-17T15:09:32.157699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:46.510097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":59,"num_write_kb":5350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'768","reported_seq":800,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.541856+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T15:10:01.541856+0000","last_peered":"2024-04-17T15:10:01.541856+0000","last_clean":"2024-04-17T15:10:01.541856+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T15:10:01.541856+0000","last_undegraded":"2024-04-17T15:10:01.541856+0000","last_fullsized":"2024-04-17T15:10:01.541856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.372991+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T15:09:36.372991+0000","last_peered":"2024-04-17T15:09:36.372991+0000","last_clean":"2024-04-17T15:09:36.372991+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T15:09:36.372991+0000","last_undegraded":"2024-04-17T15:09:36.372991+0000","last_fullsized":"2024-04-17T15:09:36.372991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:33:51.948129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2033,"num_write":68,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'541","reported_seq":573,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.089549+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T15:09:57.089549+0000","last_peered":"2024-04-17T15:09:57.089549+0000","last_clean":"2024-04-17T15:09:57.089549+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T15:09:57.089549+0000","last_undegraded":"2024-04-17T15:09:57.089549+0000","last_fullsized":"2024-04-17T15:09:57.089549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'6","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807877+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T15:09:51.807877+0000","last_peered":"2024-04-17T15:09:51.807877+0000","last_clean":"2024-04-17T15:09:51.807877+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T15:09:51.807877+0000","last_undegraded":"2024-04-17T15:09:51.807877+0000","last_fullsized":"2024-04-17T15:09:51.807877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'89","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.529371+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T15:09:32.529371+0000","last_peered":"2024-04-17T15:09:32.529371+0000","last_clean":"2024-04-17T15:09:32.529371+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T15:09:32.529371+0000","last_undegraded":"2024-04-17T15:09:32.529371+0000","last_fullsized":"2024-04-17T15:09:32.529371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":71,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.696010+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T15:08:58.696010+0000","last_peered":"2024-04-17T15:08:58.696010+0000","last_clean":"2024-04-17T15:08:58.696010+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T15:08:58.696010+0000","last_undegraded":"2024-04-17T15:08:58.696010+0000","last_fullsized":"2024-04-17T15:08:58.696010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'74","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.178722+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T15:09:13.178722+0000","last_peered":"2024-04-17T15:09:13.178722+0000","last_clean":"2024-04-17T15:09:13.178722+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T15:09:13.178722+0000","last_undegraded":"2024-04-17T15:09:13.178722+0000","last_fullsized":"2024-04-17T15:09:13.178722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":63,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:58.896466+0000","last_change":"2024-04-17T14:39:58.254649+0000","last_active":"2024-04-17T15:08:58.896466+0000","last_peered":"2024-04-17T15:08:58.896466+0000","last_clean":"2024-04-17T15:08:58.896466+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T15:08:58.896466+0000","last_undegraded":"2024-04-17T15:08:58.896466+0000","last_fullsized":"2024-04-17T15:08:58.896466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'85","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.238470+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T15:09:32.238470+0000","last_peered":"2024-04-17T15:09:32.238470+0000","last_clean":"2024-04-17T15:09:32.238470+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T15:09:32.238470+0000","last_undegraded":"2024-04-17T15:09:32.238470+0000","last_fullsized":"2024-04-17T15:09:32.238470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1337,"num_write":72,"num_write_kb":6000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'3","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.636328+0000","last_change":"2024-04-17T14:39:58.257881+0000","last_active":"2024-04-17T15:09:41.636328+0000","last_peered":"2024-04-17T15:09:41.636328+0000","last_clean":"2024-04-17T15:09:41.636328+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T15:09:41.636328+0000","last_undegraded":"2024-04-17T15:09:41.636328+0000","last_fullsized":"2024-04-17T15:09:41.636328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'75","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.244057+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T15:09:32.244057+0000","last_peered":"2024-04-17T15:09:32.244057+0000","last_clean":"2024-04-17T15:09:32.244057+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T15:09:32.244057+0000","last_undegraded":"2024-04-17T15:09:32.244057+0000","last_fullsized":"2024-04-17T15:09:32.244057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":59,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'391","reported_seq":423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.585352+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T15:10:01.585352+0000","last_peered":"2024-04-17T15:10:01.585352+0000","last_clean":"2024-04-17T15:10:01.585352+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T15:10:01.585352+0000","last_undegraded":"2024-04-17T15:10:01.585352+0000","last_fullsized":"2024-04-17T15:10:01.585352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'73","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.078004+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T15:09:32.078004+0000","last_peered":"2024-04-17T15:09:32.078004+0000","last_clean":"2024-04-17T15:09:32.078004+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T15:09:32.078004+0000","last_undegraded":"2024-04-17T15:09:32.078004+0000","last_fullsized":"2024-04-17T15:09:32.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:02.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":63,"num_write_kb":3236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'925","reported_seq":957,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301326+0000","last_change":"2024-04-17T14:39:58.253730+0000","last_active":"2024-04-17T15:10:04.301326+0000","last_peered":"2024-04-17T15:10:04.301326+0000","last_clean":"2024-04-17T15:10:04.301326+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T15:10:04.301326+0000","last_undegraded":"2024-04-17T15:10:04.301326+0000","last_fullsized":"2024-04-17T15:10:04.301326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:14:17.104810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":4530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'79","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.090178+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T15:09:30.090178+0000","last_peered":"2024-04-17T15:09:30.090178+0000","last_clean":"2024-04-17T15:09:30.090178+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T15:09:30.090178+0000","last_undegraded":"2024-04-17T15:09:30.090178+0000","last_fullsized":"2024-04-17T15:09:30.090178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":66,"num_write_kb":2869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'63","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.301348+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T15:10:04.301348+0000","last_peered":"2024-04-17T15:10:04.301348+0000","last_clean":"2024-04-17T15:10:04.301348+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T15:10:04.301348+0000","last_undegraded":"2024-04-17T15:10:04.301348+0000","last_fullsized":"2024-04-17T15:10:04.301348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680040,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'76","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.153660+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T15:09:30.153660+0000","last_peered":"2024-04-17T15:09:30.153660+0000","last_clean":"2024-04-17T15:09:30.153660+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T15:09:30.153660+0000","last_undegraded":"2024-04-17T15:09:30.153660+0000","last_fullsized":"2024-04-17T15:09:30.153660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1082,"num_write":62,"num_write_kb":6883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'8","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.747281+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T15:10:06.747281+0000","last_peered":"2024-04-17T15:10:06.747281+0000","last_clean":"2024-04-17T15:10:06.747281+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T15:10:06.747281+0000","last_undegraded":"2024-04-17T15:10:06.747281+0000","last_fullsized":"2024-04-17T15:10:06.747281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'103","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.608652+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T15:09:32.608652+0000","last_peered":"2024-04-17T15:09:32.608652+0000","last_clean":"2024-04-17T15:09:32.608652+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T15:09:32.608652+0000","last_undegraded":"2024-04-17T15:09:32.608652+0000","last_fullsized":"2024-04-17T15:09:32.608652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:16.456665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:47.607063+0000","last_change":"2024-04-17T14:39:58.256771+0000","last_active":"2024-04-17T15:09:47.607063+0000","last_peered":"2024-04-17T15:09:47.607063+0000","last_clean":"2024-04-17T15:09:47.607063+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T15:09:47.607063+0000","last_undegraded":"2024-04-17T15:09:47.607063+0000","last_fullsized":"2024-04-17T15:09:47.607063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.156988+0000","last_change":"2024-04-17T14:39:59.405314+0000","last_active":"2024-04-17T15:09:32.156988+0000","last_peered":"2024-04-17T15:09:32.156988+0000","last_clean":"2024-04-17T15:09:32.156988+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T15:09:32.156988+0000","last_undegraded":"2024-04-17T15:09:32.156988+0000","last_fullsized":"2024-04-17T15:09:32.156988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:21.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":55,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626072+0000","last_change":"2024-04-17T14:39:58.245977+0000","last_active":"2024-04-17T15:09:41.626072+0000","last_peered":"2024-04-17T15:09:41.626072+0000","last_clean":"2024-04-17T15:09:41.626072+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T15:09:41.626072+0000","last_undegraded":"2024-04-17T15:09:41.626072+0000","last_fullsized":"2024-04-17T15:09:41.626072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'75","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.259115+0000","last_change":"2024-04-17T14:39:59.416809+0000","last_active":"2024-04-17T15:09:13.259115+0000","last_peered":"2024-04-17T15:09:13.259115+0000","last_clean":"2024-04-17T15:09:13.259115+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T15:09:13.259115+0000","last_undegraded":"2024-04-17T15:09:13.259115+0000","last_fullsized":"2024-04-17T15:09:13.259115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:57.215025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3310,"num_write":61,"num_write_kb":6412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:56.950030+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T15:09:56.950030+0000","last_peered":"2024-04-17T15:09:56.950030+0000","last_clean":"2024-04-17T15:09:56.950030+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T15:09:56.950030+0000","last_undegraded":"2024-04-17T15:09:56.950030+0000","last_fullsized":"2024-04-17T15:09:56.950030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'40","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.108126+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T15:09:13.108126+0000","last_peered":"2024-04-17T15:09:13.108126+0000","last_clean":"2024-04-17T15:09:13.108126+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T15:09:13.108126+0000","last_undegraded":"2024-04-17T15:09:13.108126+0000","last_fullsized":"2024-04-17T15:09:13.108126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":33,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:13.693051+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T15:09:13.693051+0000","last_peered":"2024-04-17T15:09:13.693051+0000","last_clean":"2024-04-17T15:09:13.693051+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T15:09:13.693051+0000","last_undegraded":"2024-04-17T15:09:13.693051+0000","last_fullsized":"2024-04-17T15:09:13.693051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:10.281741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'60","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:43.557898+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T15:08:43.557898+0000","last_peered":"2024-04-17T15:08:43.557898+0000","last_clean":"2024-04-17T15:08:43.557898+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T15:08:43.557898+0000","last_undegraded":"2024-04-17T15:08:43.557898+0000","last_fullsized":"2024-04-17T15:08:43.557898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:14:06.886739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":47,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'4","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.784425+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T15:09:51.784425+0000","last_peered":"2024-04-17T15:09:51.784425+0000","last_clean":"2024-04-17T15:09:51.784425+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T15:09:51.784425+0000","last_undegraded":"2024-04-17T15:09:51.784425+0000","last_fullsized":"2024-04-17T15:09:51.784425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'88","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.583653+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T15:09:32.583653+0000","last_peered":"2024-04-17T15:09:32.583653+0000","last_clean":"2024-04-17T15:09:32.583653+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T15:09:32.583653+0000","last_undegraded":"2024-04-17T15:09:32.583653+0000","last_fullsized":"2024-04-17T15:09:32.583653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:37.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":1779,"num_write":77,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807444+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T15:09:51.807444+0000","last_peered":"2024-04-17T15:09:51.807444+0000","last_clean":"2024-04-17T15:09:51.807444+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T15:09:51.807444+0000","last_undegraded":"2024-04-17T15:09:51.807444+0000","last_fullsized":"2024-04-17T15:09:51.807444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:49.353180+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T15:08:49.353180+0000","last_peered":"2024-04-17T15:08:49.353180+0000","last_clean":"2024-04-17T15:08:49.353180+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T15:08:49.353180+0000","last_undegraded":"2024-04-17T15:08:49.353180+0000","last_fullsized":"2024-04-17T15:08:49.353180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:13.364510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":68,"num_write_kb":2018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:07:23.887226+0000","last_change":"2024-04-17T14:39:20.282238+0000","last_active":"2024-04-17T15:07:23.887226+0000","last_peered":"2024-04-17T15:07:23.887226+0000","last_clean":"2024-04-17T15:07:23.887226+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T15:07:23.887226+0000","last_undegraded":"2024-04-17T15:07:23.887226+0000","last_fullsized":"2024-04-17T15:07:23.887226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:18.732149+0000","last_clean_scrub_stamp":"2024-04-17T14:39:18.732149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:58.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'7","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652462+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T15:10:01.652462+0000","last_peered":"2024-04-17T15:10:01.652462+0000","last_clean":"2024-04-17T15:10:01.652462+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T15:10:01.652462+0000","last_undegraded":"2024-04-17T15:10:01.652462+0000","last_fullsized":"2024-04-17T15:10:01.652462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:01.467487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'82","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:38.539265+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T15:08:38.539265+0000","last_peered":"2024-04-17T15:08:38.539265+0000","last_clean":"2024-04-17T15:08:38.539265+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T15:08:38.539265+0000","last_undegraded":"2024-04-17T15:08:38.539265+0000","last_fullsized":"2024-04-17T15:08:38.539265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:08:53.946478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2040,"num_write":75,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'211","reported_seq":246,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.097540+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T15:09:57.097540+0000","last_peered":"2024-04-17T15:09:57.097540+0000","last_clean":"2024-04-17T15:09:57.097540+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T15:09:57.097540+0000","last_undegraded":"2024-04-17T15:09:57.097540+0000","last_fullsized":"2024-04-17T15:09:57.097540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'80","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:17.795863+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T15:09:17.795863+0000","last_peered":"2024-04-17T15:09:17.795863+0000","last_clean":"2024-04-17T15:09:17.795863+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T15:09:17.795863+0000","last_undegraded":"2024-04-17T15:09:17.795863+0000","last_fullsized":"2024-04-17T15:09:17.795863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":73,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'621","reported_seq":1270,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.543365+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T15:10:01.543365+0000","last_peered":"2024-04-17T15:10:01.543365+0000","last_clean":"2024-04-17T15:10:01.543365+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T15:10:01.543365+0000","last_undegraded":"2024-04-17T15:10:01.543365+0000","last_fullsized":"2024-04-17T15:10:01.543365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244218,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":617,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'63","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.245350+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T15:09:32.245350+0000","last_peered":"2024-04-17T15:09:32.245350+0000","last_clean":"2024-04-17T15:09:32.245350+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T15:09:32.245350+0000","last_undegraded":"2024-04-17T15:09:32.245350+0000","last_fullsized":"2024-04-17T15:09:32.245350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":53,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.718195+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T15:10:06.718195+0000","last_peered":"2024-04-17T15:10:06.718195+0000","last_clean":"2024-04-17T15:10:06.718195+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T15:10:06.718195+0000","last_undegraded":"2024-04-17T15:10:06.718195+0000","last_fullsized":"2024-04-17T15:10:06.718195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:05.316939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'57","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.104672+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T15:09:32.104672+0000","last_peered":"2024-04-17T15:09:32.104672+0000","last_clean":"2024-04-17T15:09:32.104672+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T15:09:32.104672+0000","last_undegraded":"2024-04-17T15:09:32.104672+0000","last_fullsized":"2024-04-17T15:09:32.104672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":47,"num_write_kb":3555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.785304+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T15:09:51.785304+0000","last_peered":"2024-04-17T15:09:51.785304+0000","last_clean":"2024-04-17T15:09:51.785304+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T15:09:51.785304+0000","last_undegraded":"2024-04-17T15:09:51.785304+0000","last_fullsized":"2024-04-17T15:09:51.785304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'76","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:08.815706+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T15:09:08.815706+0000","last_peered":"2024-04-17T15:09:08.815706+0000","last_clean":"2024-04-17T15:09:08.815706+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T15:09:08.815706+0000","last_undegraded":"2024-04-17T15:09:08.815706+0000","last_fullsized":"2024-04-17T15:09:08.815706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:04.019454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":66,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.651305+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T15:10:01.651305+0000","last_peered":"2024-04-17T15:10:01.651305+0000","last_clean":"2024-04-17T15:10:01.651305+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T15:10:01.651305+0000","last_undegraded":"2024-04-17T15:10:01.651305+0000","last_fullsized":"2024-04-17T15:10:01.651305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:24.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'76","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:09.019032+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T15:09:09.019032+0000","last_peered":"2024-04-17T15:09:09.019032+0000","last_clean":"2024-04-17T15:09:09.019032+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T15:09:09.019032+0000","last_undegraded":"2024-04-17T15:09:09.019032+0000","last_fullsized":"2024-04-17T15:09:09.019032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":61,"num_write_kb":2647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1175","reported_seq":1208,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:04.857741+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T15:10:04.857741+0000","last_peered":"2024-04-17T15:10:04.857741+0000","last_clean":"2024-04-17T15:10:04.857741+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T15:10:04.857741+0000","last_undegraded":"2024-04-17T15:10:04.857741+0000","last_fullsized":"2024-04-17T15:10:04.857741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2894,"num_write_kb":1176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'85","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.299288+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T15:09:32.299288+0000","last_peered":"2024-04-17T15:09:32.299288+0000","last_clean":"2024-04-17T15:09:32.299288+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T15:09:32.299288+0000","last_undegraded":"2024-04-17T15:09:32.299288+0000","last_fullsized":"2024-04-17T15:09:32.299288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:11.084732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3434,"num_write":74,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'9","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.650974+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T15:10:01.650974+0000","last_peered":"2024-04-17T15:10:01.650974+0000","last_clean":"2024-04-17T15:10:01.650974+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T15:10:01.650974+0000","last_undegraded":"2024-04-17T15:10:01.650974+0000","last_fullsized":"2024-04-17T15:10:01.650974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:13.321282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'69","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:30.212615+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T15:09:30.212615+0000","last_peered":"2024-04-17T15:09:30.212615+0000","last_clean":"2024-04-17T15:09:30.212615+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T15:09:30.212615+0000","last_undegraded":"2024-04-17T15:09:30.212615+0000","last_fullsized":"2024-04-17T15:09:30.212615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:57:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":52,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.647588+0000","last_change":"2024-04-17T14:39:58.257512+0000","last_active":"2024-04-17T15:10:01.647588+0000","last_peered":"2024-04-17T15:10:01.647588+0000","last_clean":"2024-04-17T15:10:01.647588+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T15:10:01.647588+0000","last_undegraded":"2024-04-17T15:10:01.647588+0000","last_fullsized":"2024-04-17T15:10:01.647588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:29.357267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'98","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.068750+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T15:09:23.068750+0000","last_peered":"2024-04-17T15:09:23.068750+0000","last_clean":"2024-04-17T15:09:23.068750+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T15:09:23.068750+0000","last_undegraded":"2024-04-17T15:09:23.068750+0000","last_fullsized":"2024-04-17T15:09:23.068750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:44:53.345326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2098,"num_write":85,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'6","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.813018+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T15:09:51.813018+0000","last_peered":"2024-04-17T15:09:51.813018+0000","last_clean":"2024-04-17T15:09:51.813018+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T15:09:51.813018+0000","last_undegraded":"2024-04-17T15:09:51.813018+0000","last_fullsized":"2024-04-17T15:09:51.813018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:08.317185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'63","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:32.300278+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T15:09:32.300278+0000","last_peered":"2024-04-17T15:09:32.300278+0000","last_clean":"2024-04-17T15:09:32.300278+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T15:09:32.300278+0000","last_undegraded":"2024-04-17T15:09:32.300278+0000","last_fullsized":"2024-04-17T15:09:32.300278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:14:02.624213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":50,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'2","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807732+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T15:09:51.807732+0000","last_peered":"2024-04-17T15:09:51.807732+0000","last_clean":"2024-04-17T15:09:51.807732+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T15:09:51.807732+0000","last_undegraded":"2024-04-17T15:09:51.807732+0000","last_fullsized":"2024-04-17T15:09:51.807732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'75","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.911205+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T15:09:29.911205+0000","last_peered":"2024-04-17T15:09:29.911205+0000","last_clean":"2024-04-17T15:09:29.911205+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T15:09:29.911205+0000","last_undegraded":"2024-04-17T15:09:29.911205+0000","last_fullsized":"2024-04-17T15:09:29.911205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":67,"num_write_kb":4068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'778","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.652042+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T15:10:01.652042+0000","last_peered":"2024-04-17T15:10:01.652042+0000","last_clean":"2024-04-17T15:10:01.652042+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T15:10:01.652042+0000","last_undegraded":"2024-04-17T15:10:01.652042+0000","last_fullsized":"2024-04-17T15:10:01.652042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:45.463725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'119","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.926443+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T15:09:29.926443+0000","last_peered":"2024-04-17T15:09:29.926443+0000","last_clean":"2024-04-17T15:09:29.926443+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T15:09:29.926443+0000","last_undegraded":"2024-04-17T15:09:29.926443+0000","last_fullsized":"2024-04-17T15:09:29.926443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:50:42.012591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":110,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'76","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:23.066946+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T15:09:23.066946+0000","last_peered":"2024-04-17T15:09:23.066946+0000","last_clean":"2024-04-17T15:09:23.066946+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T15:09:23.066946+0000","last_undegraded":"2024-04-17T15:09:23.066946+0000","last_fullsized":"2024-04-17T15:09:23.066946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:37.160101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2294,"num_write":58,"num_write_kb":5884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.085826+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T15:09:57.085826+0000","last_peered":"2024-04-17T15:09:57.085826+0000","last_clean":"2024-04-17T15:09:57.085826+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T15:09:57.085826+0000","last_undegraded":"2024-04-17T15:09:57.085826+0000","last_fullsized":"2024-04-17T15:09:57.085826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:02.973081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'62","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:36.353652+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T15:09:36.353652+0000","last_peered":"2024-04-17T15:09:36.353652+0000","last_clean":"2024-04-17T15:09:36.353652+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T15:09:36.353652+0000","last_undegraded":"2024-04-17T15:09:36.353652+0000","last_fullsized":"2024-04-17T15:09:36.353652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":47,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1266","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.648803+0000","last_change":"2024-04-17T14:39:58.257515+0000","last_active":"2024-04-17T15:10:01.648803+0000","last_peered":"2024-04-17T15:10:01.648803+0000","last_clean":"2024-04-17T15:10:01.648803+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T15:10:01.648803+0000","last_undegraded":"2024-04-17T15:10:01.648803+0000","last_fullsized":"2024-04-17T15:10:01.648803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:20.522839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":8829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'116","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:08:34.452732+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T15:08:34.452732+0000","last_peered":"2024-04-17T15:08:34.452732+0000","last_clean":"2024-04-17T15:08:34.452732+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T15:08:34.452732+0000","last_undegraded":"2024-04-17T15:08:34.452732+0000","last_fullsized":"2024-04-17T15:08:34.452732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":107,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'779","reported_seq":813,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.740693+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T15:09:41.740693+0000","last_peered":"2024-04-17T15:09:41.740693+0000","last_clean":"2024-04-17T15:09:41.740693+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T15:09:41.740693+0000","last_undegraded":"2024-04-17T15:09:41.740693+0000","last_fullsized":"2024-04-17T15:09:41.740693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'90","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:29.889222+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T15:09:29.889222+0000","last_peered":"2024-04-17T15:09:29.889222+0000","last_clean":"2024-04-17T15:09:29.889222+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T15:09:29.889222+0000","last_undegraded":"2024-04-17T15:09:29.889222+0000","last_fullsized":"2024-04-17T15:09:29.889222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":83,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'707","reported_seq":741,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.626443+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T15:09:41.626443+0000","last_peered":"2024-04-17T15:09:41.626443+0000","last_clean":"2024-04-17T15:09:41.626443+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T15:09:41.626443+0000","last_undegraded":"2024-04-17T15:09:41.626443+0000","last_fullsized":"2024-04-17T15:09:41.626443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:26:17.755922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":137179,"num_write":4261,"num_write_kb":326145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5036,"ondisk_log_size":5036,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38674430,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":615,"num_read_kb":704,"num_write":9921,"num_write_kb":42584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77422592,"data_stored":77360270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8318,"ondisk_log_size":8318,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509815,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":4452352,"data_stored":4288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":8460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":8663040,"data_stored":8484412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43656,"kb_used_data":16640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328184,"statfs":{"total":96636764160,"available":96592060416,"internally_reserved":0,"allocated":17039360,"data_stored":16872258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509814,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52108,"kb_used_data":8452,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319732,"statfs":{"total":96636764160,"available":96583405568,"internally_reserved":0,"allocated":8654848,"data_stored":8483740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509815,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48524,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323316,"statfs":{"total":96636764160,"available":96587075584,"internally_reserved":0,"allocated":9244672,"data_stored":9073506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509815,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44392,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327448,"statfs":{"total":96636764160,"available":96591306752,"internally_reserved":0,"allocated":13533184,"data_stored":13357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":5390336,"data_stored":5213112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542518,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40384,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":13688832,"data_stored":13512050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13283328,"data_stored":13274384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12836864,"data_stored":12827222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5132288,"data_stored":5118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:10:11.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:10:11.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.535+0000 7fa625c00640 1 Processor -- start 2024-04-17T15:10:11.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.535+0000 7fa625c00640 1 -- start start 2024-04-17T15:10:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa625c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa62015adc0 0x7fa6200ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa625c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6200c94f0 0x7fa6200c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa625c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200c8d40 con 0x7fa620155080 2024-04-17T15:10:11.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa625c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa62015b1e0 con 0x7fa6200c94f0 2024-04-17T15:10:11.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa625c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa62015f360 con 0x7fa62015adc0 2024-04-17T15:10:11.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa61f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6200c94f0 0x7fa6200c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa61f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6200c94f0 0x7fa6200c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39698/0 (socket says 172.21.15.16:39698) 2024-04-17T15:10:11.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa61f400640 1 -- 172.21.15.16:0/3415656415 learned_addr learned my addr 172.21.15.16:0/3415656415 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:11.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa61ea00640 1 --1- 172.21.15.16:0/3415656415 >> v1:172.21.15.16:6789/0 conn(0x7fa620155080 0x7fa62015ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53858/0 (socket says 172.21.15.16:53858) 2024-04-17T15:10:11.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.539+0000 7fa617e00640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa62015adc0 0x7fa6200ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.543+0000 7fa61f400640 1 -- 172.21.15.16:0/3415656415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa62015adc0 msgr2=0x7fa6200ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:11.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.543+0000 7fa61f400640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa62015adc0 0x7fa6200ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.543+0000 7fa61f400640 1 -- 172.21.15.16:0/3415656415 >> v1:172.21.15.16:6789/0 conn(0x7fa620155080 legacy=0x7fa62015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.543+0000 7fa61f400640 1 -- 172.21.15.16:0/3415656415 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62015b400 con 0x7fa6200c94f0 2024-04-17T15:10:11.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.547+0000 7fa61f400640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6200c94f0 0x7fa6200c9980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa618009e50 tx=0x7fa61801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934e6c03b614bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:11.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa61e000640 1 -- 172.21.15.16:0/3415656415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b4070 con 0x7fa6200c94f0 2024-04-17T15:10:11.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa61e000640 1 -- 172.21.15.16:0/3415656415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180af400 con 0x7fa6200c94f0 2024-04-17T15:10:11.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa61e000640 1 -- 172.21.15.16:0/3415656415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180af7d0 con 0x7fa6200c94f0 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 -- 172.21.15.16:0/3415656415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6200c94f0 msgr2=0x7fa6200c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6200c94f0 0x7fa6200c9980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa618009e50 tx=0x7fa61801f210 comp rx=0 tx=0).stop 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 -- 172.21.15.16:0/3415656415 shutdown_connections 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6200c94f0 0x7fa6200c9980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 --2- 172.21.15.16:0/3415656415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa62015adc0 0x7fa6200ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 -- 172.21.15.16:0/3415656415 >> 172.21.15.16:0/3415656415 conn(0x7fa62006fd20 msgr2=0x7fa620070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 -- 172.21.15.16:0/3415656415 shutdown_connections 2024-04-17T15:10:11.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.551+0000 7fa625c00640 1 -- 172.21.15.16:0/3415656415 wait complete. 2024-04-17T15:10:11.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 Processor -- start 2024-04-17T15:10:11.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 -- start start 2024-04-17T15:10:11.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6200c94f0 0x7fa62015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa620155080 0x7fa620153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa62015b9c0 con 0x7fa62015adc0 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200c9ec0 con 0x7fa620155080 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa625c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa62015e450 con 0x7fa6200c94f0 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa61f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa61f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39700/0 (socket says 172.21.15.16:39700) 2024-04-17T15:10:11.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa61f400640 1 -- 172.21.15.16:0/2228303870 learned_addr learned my addr 172.21.15.16:0/2228303870 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:11.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa61ea00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6200c94f0 0x7fa62015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.555+0000 7fa617e00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa620155080 0x7fa620153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.559+0000 7fa61f400640 1 -- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6200c94f0 msgr2=0x7fa62015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.559+0000 7fa61f400640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6200c94f0 0x7fa62015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.559+0000 7fa61f400640 1 -- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa620155080 msgr2=0x7fa620153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.559+0000 7fa61f400640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa620155080 0x7fa620153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.559+0000 7fa61f400640 1 -- 172.21.15.16:0/2228303870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6201f1580 con 0x7fa62015adc0 2024-04-17T15:10:11.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.563+0000 7fa61f400640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa61801d8c0 tx=0x7fa61801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b4040 con 0x7fa62015adc0 2024-04-17T15:10:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180bf070 con 0x7fa62015adc0 2024-04-17T15:10:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b9410 con 0x7fa62015adc0 2024-04-17T15:10:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6201f1800 con 0x7fa62015adc0 2024-04-17T15:10:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa620152a90 con 0x7fa62015adc0 2024-04-17T15:10:11.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.567+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620076280 con 0x7fa62015adc0 2024-04-17T15:10:11.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.587+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6180a8d10 con 0x7fa62015adc0 2024-04-17T15:10:11.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.587+0000 7fa616a00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 0x7fa5fc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:11.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.587+0000 7fa61ea00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 0x7fa5fc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:11.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.587+0000 7fa61ea00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 0x7fa5fc06a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa610000f70 tx=0x7fa610007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:11.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.847+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa618002020 con 0x7fa62015adc0 2024-04-17T15:10:11.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:11.847+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa6201f1580 con 0x7fa62015adc0 2024-04-17T15:10:12.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.023+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6200cb5c0 con 0x7fa62015adc0 2024-04-17T15:10:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.119+0000 7fa616a00640 1 -- 172.21.15.16:0/2228303870 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7fa618018d70 con 0x7fa62015adc0 2024-04-17T15:10:12.122 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:12.122 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 msgr2=0x7fa5fc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 0x7fa5fc06a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa610000f70 tx=0x7fa610007e90 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 msgr2=0x7fa620153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa61801d8c0 tx=0x7fa61801bfb0 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 shutdown_connections 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa5fc0683d0 0x7fa5fc06a890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa62015adc0 0x7fa620153ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa620155080 0x7fa620153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 --2- 172.21.15.16:0/2228303870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6200c94f0 0x7fa62015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 >> 172.21.15.16:0/2228303870 conn(0x7fa62006fd20 msgr2=0x7fa620074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 shutdown_connections 2024-04-17T15:10:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:12.123+0000 7fa625c00640 1 -- 172.21.15.16:0/2228303870 wait complete. 2024-04-17T15:10:13.145 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T15:10:13.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:13.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 Processor -- start 2024-04-17T15:10:13.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 -- start start 2024-04-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c301583c0 0x7f9c3015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c3015b3b0 0x7f9c300ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c300c9880 con 0x7f9c300c8f60 2024-04-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3006ba30 con 0x7f9c3015b3b0 2024-04-17T15:10:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c34c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3006c240 con 0x7f9c301583c0 2024-04-17T15:10:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c2ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c3015b3b0 0x7f9c300ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c2ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c3015b3b0 0x7f9c300ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39714/0 (socket says 172.21.15.16:39714) 2024-04-17T15:10:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.299+0000 7f9c2ea00640 1 -- 172.21.15.16:0/389456829 learned_addr learned my addr 172.21.15.16:0/389456829 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.303+0000 7f9c2f400640 1 --2- 172.21.15.16:0/389456829 >> v2:172.21.15.67:3300/0 conn(0x7f9c301583c0 0x7f9c3015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.303+0000 7f9c2ea00640 1 -- 172.21.15.16:0/389456829 >> v2:172.21.15.67:3300/0 conn(0x7f9c301583c0 msgr2=0x7f9c3015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.303+0000 7f9c2ea00640 1 --2- 172.21.15.16:0/389456829 >> v2:172.21.15.67:3300/0 conn(0x7f9c301583c0 0x7f9c3015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.303+0000 7f9c2ea00640 1 -- 172.21.15.16:0/389456829 >> v1:172.21.15.67:6789/0 conn(0x7f9c300c8f60 legacy=0x7f9c3015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.303+0000 7f9c2ea00640 1 -- 172.21.15.16:0/389456829 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c300cba90 con 0x7f9c3015b3b0 2024-04-17T15:10:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.307+0000 7f9c2ea00640 1 --2- 172.21.15.16:0/389456829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3015b3b0 0x7f9c300ca4d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c300cafc0 tx=0x7f9c1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43182621407f33f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c2e000640 1 -- 172.21.15.16:0/389456829 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0ab650 con 0x7f9c3015b3b0 2024-04-17T15:10:13.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c2e000640 1 -- 172.21.15.16:0/389456829 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0b0070 con 0x7f9c3015b3b0 2024-04-17T15:10:13.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c2e000640 1 -- 172.21.15.16:0/389456829 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0aba10 con 0x7f9c3015b3b0 2024-04-17T15:10:13.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- 172.21.15.16:0/389456829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3015b3b0 msgr2=0x7f9c300ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 --2- 172.21.15.16:0/389456829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3015b3b0 0x7f9c300ca4d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c300cafc0 tx=0x7f9c1c01c450 comp rx=0 tx=0).stop 2024-04-17T15:10:13.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- 172.21.15.16:0/389456829 shutdown_connections 2024-04-17T15:10:13.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 --2- 172.21.15.16:0/389456829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3015b3b0 0x7f9c300ca4d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 --2- 172.21.15.16:0/389456829 >> v2:172.21.15.67:3300/0 conn(0x7f9c301583c0 0x7f9c3015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- 172.21.15.16:0/389456829 >> 172.21.15.16:0/389456829 conn(0x7f9c30062c10 msgr2=0x7f9c3006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:13.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- 172.21.15.16:0/389456829 shutdown_connections 2024-04-17T15:10:13.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- 172.21.15.16:0/389456829 wait complete. 2024-04-17T15:10:13.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 Processor -- start 2024-04-17T15:10:13.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.311+0000 7f9c34c00640 1 -- start start 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c300c8f60 0x7f9c30152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c301583c0 0x7f9c301f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 0x7f9c300cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301587a0 con 0x7f9c301f42a0 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30070970 con 0x7f9c300c8f60 2024-04-17T15:10:13.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c34c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f9c30158920 con 0x7f9c301583c0 2024-04-17T15:10:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c2fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 0x7f9c300cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c2fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 0x7f9c300cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39724/0 (socket says 172.21.15.16:39724) 2024-04-17T15:10:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c2fe00640 1 -- 172.21.15.16:0/177658015 learned_addr learned my addr 172.21.15.16:0/177658015 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c2ea00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c301583c0 0x7f9c301f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.315+0000 7f9c2f400640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c300c8f60 0x7f9c30152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 -- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c301583c0 msgr2=0x7f9c301f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9c301583c0 0x7f9c301f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 -- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c300c8f60 msgr2=0x7f9c30152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c300c8f60 0x7f9c30152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301f81c0 con 0x7f9c301f42a0 2024-04-17T15:10:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.319+0000 7f9c2fe00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 0x7f9c300cc360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c7b0 tx=0x7f9c2800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28016020 con 0x7f9c301f42a0 2024-04-17T15:10:13.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2800a9f0 con 0x7f9c301f42a0 2024-04-17T15:10:13.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800ade0 con 0x7f9c301f42a0 2024-04-17T15:10:13.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c300cce10 con 0x7f9c301f42a0 2024-04-17T15:10:13.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301f76e0 con 0x7f9c301f42a0 2024-04-17T15:10:13.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.323+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c300cd0f0 con 0x7f9c301f42a0 2024-04-17T15:10:13.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.343+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c28019020 con 0x7f9c301f42a0 2024-04-17T15:10:13.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.347+0000 7f9c27400640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9c100683d0 0x7f9c1006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.347+0000 7f9c2f400640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9c100683d0 0x7f9c1006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.347+0000 7f9c2f400640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9c100683d0 0x7f9c1006a890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000aae0 tx=0x7f9c20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9c28054d20 con 0x7f9c301f42a0 2024-04-17T15:10:13.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c27400640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f9c10070630 0x7f9c10072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c28010e50 con 0x7f9c10070630 2024-04-17T15:10:13.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c2ea00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f9c10070630 0x7f9c10072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c2ea00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f9c10070630 0x7f9c10072a50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== osd.0 v2:172.21.15.16:6805/2573416499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c28010e50 con 0x7f9c10070630 2024-04-17T15:10:13.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.351+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c28052f20 con 0x7f9c301f42a0 2024-04-17T15:10:13.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.363+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 --> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9c300761a0 con 0x7f9c10070630 2024-04-17T15:10:13.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.363+0000 7f9c27400640 1 -- 172.21.15.16:0/177658015 <== osd.0 v2:172.21.15.16:6805/2573416499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9c300761a0 con 0x7f9c10070630 2024-04-17T15:10:13.366 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:13.366 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f9c10070630 msgr2=0x7f9c10072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:6805/2573416499,v1:172.21.15.16:6807/2573416499] conn(0x7f9c10070630 0x7f9c10072a50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9c100683d0 msgr2=0x7f9c1006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f9c100683d0 0x7f9c1006a890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000aae0 tx=0x7f9c20008040 comp rx=0 tx=0).stop 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 msgr2=0x7f9c300cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 --2- 172.21.15.16:0/177658015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c301f42a0 0x7f9c300cc360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c7b0 tx=0x7f9c2800cc70 comp rx=0 tx=0).stop 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c2fe00640 1 -- 172.21.15.16:0/177658015 reap_dead start 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 shutdown_connections 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 >> 172.21.15.16:0/177658015 conn(0x7f9c30062c10 msgr2=0x7f9c300b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 shutdown_connections 2024-04-17T15:10:13.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.367+0000 7f9c34c00640 1 -- 172.21.15.16:0/177658015 wait complete. 2024-04-17T15:10:13.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T15:10:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 Processor -- start 2024-04-17T15:10:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 -- start start 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6870151db0 0x7f68700c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f687015be40 0x7f6870157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6870158110 0x7f68700c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f68700c8be0 con 0x7f687015be40 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6870071b30 con 0x7f6870158110 2024-04-17T15:10:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6877e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f6870158610 con 0x7f6870151db0 2024-04-17T15:10:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6874a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f687015be40 0x7f6870157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6874a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f687015be40 0x7f6870157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39732/0 (socket says 172.21.15.16:39732) 2024-04-17T15:10:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6874a00640 1 -- 172.21.15.16:0/711115307 learned_addr learned my addr 172.21.15.16:0/711115307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:13.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6875400640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6870151db0 0x7f68700c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.531+0000 7f6875e00640 1 --2- 172.21.15.16:0/711115307 >> v2:172.21.15.67:3300/0 conn(0x7f6870158110 0x7f68700c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.535+0000 7f6874a00640 1 -- 172.21.15.16:0/711115307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6870151db0 msgr2=0x7f68700c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:13.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.535+0000 7f6874a00640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6870151db0 0x7f68700c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.535+0000 7f6874a00640 1 -- 172.21.15.16:0/711115307 >> v2:172.21.15.67:3300/0 conn(0x7f6870158110 msgr2=0x7f68700c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.535+0000 7f6874a00640 1 --2- 172.21.15.16:0/711115307 >> v2:172.21.15.67:3300/0 conn(0x7f6870158110 0x7f68700c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.535+0000 7f6874a00640 1 -- 172.21.15.16:0/711115307 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68701588f0 con 0x7f687015be40 2024-04-17T15:10:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.539+0000 7f6874a00640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f687015be40 0x7f6870157bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68700c5940 tx=0x7f685c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9815db2425776d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f686fe00640 1 -- 172.21.15.16:0/711115307 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b5070 con 0x7f687015be40 2024-04-17T15:10:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f686fe00640 1 -- 172.21.15.16:0/711115307 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0a89d0 con 0x7f687015be40 2024-04-17T15:10:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f686fe00640 1 -- 172.21.15.16:0/711115307 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0a8da0 con 0x7f687015be40 2024-04-17T15:10:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- 172.21.15.16:0/711115307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f687015be40 msgr2=0x7f6870157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f687015be40 0x7f6870157bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68700c5940 tx=0x7f685c01ed10 comp rx=0 tx=0).stop 2024-04-17T15:10:13.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- 172.21.15.16:0/711115307 shutdown_connections 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 --2- 172.21.15.16:0/711115307 >> v2:172.21.15.67:3300/0 conn(0x7f6870158110 0x7f68700c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f687015be40 0x7f6870157bd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 --2- 172.21.15.16:0/711115307 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6870151db0 0x7f68700c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- 172.21.15.16:0/711115307 >> 172.21.15.16:0/711115307 conn(0x7f687006ba30 msgr2=0x7f687006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- 172.21.15.16:0/711115307 shutdown_connections 2024-04-17T15:10:13.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- 172.21.15.16:0/711115307 wait complete. 2024-04-17T15:10:13.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 Processor -- start 2024-04-17T15:10:13.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.543+0000 7f6877e00640 1 -- start start 2024-04-17T15:10:13.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6870158110 0x7f68701524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f687015be40 0x7f68700cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f687015b920 con 0x7f6870151db0 2024-04-17T15:10:13.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f687015b640 con 0x7f6870158110 2024-04-17T15:10:13.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6877e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f6870152190 con 0x7f687015be40 2024-04-17T15:10:13.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6875400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6875400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39748/0 (socket says 172.21.15.16:39748) 2024-04-17T15:10:13.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6875400640 1 -- 172.21.15.16:0/2378341898 learned_addr learned my addr 172.21.15.16:0/2378341898 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:13.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6874a00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6870158110 0x7f68701524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.547+0000 7f6875e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f687015be40 0x7f68700cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 -- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f687015be40 msgr2=0x7f68700cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f687015be40 0x7f68700cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 -- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6870158110 msgr2=0x7f68701524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:13.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6870158110 0x7f68701524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:13.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 -- 172.21.15.16:0/2378341898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700cbae0 con 0x7f6870151db0 2024-04-17T15:10:13.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.551+0000 7f6875400640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f686400d830 tx=0x7f686400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.555+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864018030 con 0x7f6870151db0 2024-04-17T15:10:13.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.555+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686400be10 con 0x7f6870151db0 2024-04-17T15:10:13.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.555+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864009850 con 0x7f6870151db0 2024-04-17T15:10:13.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.555+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68700cbdc0 con 0x7f6870151db0 2024-04-17T15:10:13.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.555+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701eeb90 con 0x7f6870151db0 2024-04-17T15:10:13.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.559+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6870076280 con 0x7f6870151db0 2024-04-17T15:10:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.579+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f686401b070 con 0x7f6870151db0 2024-04-17T15:10:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.579+0000 7f686d600640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 0x7f685006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:13.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.579+0000 7f6874a00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 0x7f685006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:13.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.579+0000 7f6874a00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 0x7f685006a890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b2000 tx=0x7f685c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:13.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.835+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6864055230 con 0x7f6870151db0 2024-04-17T15:10:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:13.839+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6864057190 con 0x7f6870151db0 2024-04-17T15:10:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f68700c4400 con 0x7f68500683d0 2024-04-17T15:10:14.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f686d600640 1 -- 172.21.15.16:0/2378341898 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f68700c4400 con 0x7f68500683d0 2024-04-17T15:10:14.011 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T15:10:14.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 msgr2=0x7f685006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 0x7f685006a890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b2000 tx=0x7f685c0aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 msgr2=0x7f68701ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f686400d830 tx=0x7f686400dcf0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 shutdown_connections 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f68500683d0 0x7f685006a890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f687015be40 0x7f68700cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6870158110 0x7f68701524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 --2- 172.21.15.16:0/2378341898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6870151db0 0x7f68701ef390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.011+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 >> 172.21.15.16:0/2378341898 conn(0x7f687006ba30 msgr2=0x7f6870073130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.015+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 shutdown_connections 2024-04-17T15:10:14.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.015+0000 7f6877e00640 1 -- 172.21.15.16:0/2378341898 wait complete. 2024-04-17T15:10:14.033 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T15:10:14.033 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 Processor -- start 2024-04-17T15:10:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 -- start start 2024-04-17T15:10:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79100c3ff0 0x7f7910159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79100c8b40 con 0x7f79100c7090 2024-04-17T15:10:14.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79100c8e20 con 0x7f7910153330 2024-04-17T15:10:14.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7916c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f79100c9100 con 0x7f79100c3ff0 2024-04-17T15:10:14.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7914c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79100c3ff0 0x7f7910159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7914c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79100c3ff0 0x7f7910159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39756/0 (socket says 172.21.15.16:39756) 2024-04-17T15:10:14.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.179+0000 7f7914c00640 1 -- 172.21.15.16:0/739602298 learned_addr learned my addr 172.21.15.16:0/739602298 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:14.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.183+0000 7f7914c00640 1 -- 172.21.15.16:0/739602298 >> v1:172.21.15.67:6789/0 conn(0x7f7910153330 legacy=0x7f791006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.183+0000 7f7914c00640 1 -- 172.21.15.16:0/739602298 >> v1:172.21.15.16:6789/0 conn(0x7f79100c7090 legacy=0x7f79100c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.183+0000 7f7914c00640 1 -- 172.21.15.16:0/739602298 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79100c93e0 con 0x7f79100c3ff0 2024-04-17T15:10:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.187+0000 7f7914c00640 1 --2- 172.21.15.16:0/739602298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f7910159960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7908009e50 tx=0x7f790801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821ee00269901797 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f790f400640 1 -- 172.21.15.16:0/739602298 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080b4070 con 0x7f79100c3ff0 2024-04-17T15:10:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f790f400640 1 -- 172.21.15.16:0/739602298 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79080af400 con 0x7f79100c3ff0 2024-04-17T15:10:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f790f400640 1 -- 172.21.15.16:0/739602298 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080af7d0 con 0x7f79100c3ff0 2024-04-17T15:10:14.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 -- 172.21.15.16:0/739602298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 msgr2=0x7f7910159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 --2- 172.21.15.16:0/739602298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f7910159960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7908009e50 tx=0x7f790801f1e0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 -- 172.21.15.16:0/739602298 shutdown_connections 2024-04-17T15:10:14.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 --2- 172.21.15.16:0/739602298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f7910159960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 -- 172.21.15.16:0/739602298 >> 172.21.15.16:0/739602298 conn(0x7f791006ba30 msgr2=0x7f791006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:14.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 -- 172.21.15.16:0/739602298 shutdown_connections 2024-04-17T15:10:14.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.191+0000 7f7916c00640 1 -- 172.21.15.16:0/739602298 wait complete. 2024-04-17T15:10:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 Processor -- start 2024-04-17T15:10:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 -- start start 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f79101e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100c7090 0x7f79100cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7910153330 0x7f79100cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f791006fdd0 con 0x7f79100c3ff0 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f791006fc50 con 0x7f79100c7090 2024-04-17T15:10:14.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.195+0000 7f7916c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f79100700f0 con 0x7f7910153330 2024-04-17T15:10:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.199+0000 7f790fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f79101e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.199+0000 7f790fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f79101e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39770/0 (socket says 172.21.15.16:39770) 2024-04-17T15:10:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.199+0000 7f790fe00640 1 -- 172.21.15.16:0/210458700 learned_addr learned my addr 172.21.15.16:0/210458700 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:14.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.203+0000 7f790fe00640 1 -- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7910153330 msgr2=0x7f79100cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.203+0000 7f790fe00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7910153330 0x7f79100cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.203+0000 7f790fe00640 1 -- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100c7090 msgr2=0x7f79100cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.203+0000 7f790fe00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100c7090 0x7f79100cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.203+0000 7f790fe00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7910156170 con 0x7f79100c3ff0 2024-04-17T15:10:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.207+0000 7f790fe00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f79101e3340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f790000b3e0 tx=0x7f790000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900015020 con 0x7f79100c3ff0 2024-04-17T15:10:14.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900011850 con 0x7f79100c3ff0 2024-04-17T15:10:14.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7910156430 con 0x7f79100c3ff0 2024-04-17T15:10:14.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900011c40 con 0x7f79100c3ff0 2024-04-17T15:10:14.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101f14e0 con 0x7f79100c3ff0 2024-04-17T15:10:14.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.211+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79100cbd10 con 0x7f79100c3ff0 2024-04-17T15:10:14.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.231+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7900018020 con 0x7f79100c3ff0 2024-04-17T15:10:14.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.235+0000 7f790cc00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f78ec0683d0 0x7f78ec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.235+0000 7f7907e00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f78ec0683d0 0x7f78ec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.235+0000 7f7907e00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f78ec0683d0 0x7f78ec06a890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000f70 tx=0x7f78f80079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7900011de0 con 0x7f79100c3ff0 2024-04-17T15:10:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f790cc00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f78ec0705d0 0x7f78ec0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7900014e70 con 0x7f78ec0705d0 2024-04-17T15:10:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7900053120 con 0x7f79100c3ff0 2024-04-17T15:10:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f7914c00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f78ec0705d0 0x7f78ec0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f7914c00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f78ec0705d0 0x7f78ec0729f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.239+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== osd.1 v2:172.21.15.16:6824/1749404511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7900014e70 con 0x7f78ec0705d0 2024-04-17T15:10:14.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 --> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7910076280 con 0x7f78ec0705d0 2024-04-17T15:10:14.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f790cc00640 1 -- 172.21.15.16:0/210458700 <== osd.1 v2:172.21.15.16:6824/1749404511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7910076280 con 0x7f78ec0705d0 2024-04-17T15:10:14.255 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:14.255 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f78ec0705d0 msgr2=0x7f78ec0729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:6824/1749404511,v1:172.21.15.16:6825/1749404511] conn(0x7f78ec0705d0 0x7f78ec0729f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f78ec0683d0 msgr2=0x7f78ec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f78ec0683d0 0x7f78ec06a890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000f70 tx=0x7f78f80079e0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 msgr2=0x7f79101e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 --2- 172.21.15.16:0/210458700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79100c3ff0 0x7f79101e3340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f790000b3e0 tx=0x7f790000b8a0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7914c00640 1 -- 172.21.15.16:0/210458700 reap_dead start 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 shutdown_connections 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 >> 172.21.15.16:0/210458700 conn(0x7f791006ba30 msgr2=0x7f79100c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 shutdown_connections 2024-04-17T15:10:14.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.255+0000 7f7916c00640 1 -- 172.21.15.16:0/210458700 wait complete. 2024-04-17T15:10:14.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T15:10:14.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.411+0000 7f3aeaa00640 1 Processor -- start 2024-04-17T15:10:14.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.411+0000 7f3aeaa00640 1 -- start start 2024-04-17T15:10:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3aeaa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ae40c3060 0x7f3ae40c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3aeaa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae4153430 con 0x7f3ae4153050 2024-04-17T15:10:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3aeaa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae40c3ed0 con 0x7f3ae40c8d20 2024-04-17T15:10:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3aeaa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae406ef10 con 0x7f3ae40c3060 2024-04-17T15:10:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3adb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ae40c3060 0x7f3ae40c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3ae3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ae4153050 0x7f3ae4159780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53870/0 (socket says 172.21.15.16:53870) 2024-04-17T15:10:14.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.415+0000 7f3ae3e00640 1 -- 172.21.15.16:0/2363913849 learned_addr learned my addr 172.21.15.16:0/2363913849 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:14.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.419+0000 7f3adb400640 1 -- 172.21.15.16:0/2363913849 >> v1:172.21.15.67:6789/0 conn(0x7f3ae40c8d20 legacy=0x7f3ae40c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.419+0000 7f3adb400640 1 -- 172.21.15.16:0/2363913849 >> v1:172.21.15.16:6789/0 conn(0x7f3ae4153050 legacy=0x7f3ae4159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.419+0000 7f3adb400640 1 -- 172.21.15.16:0/2363913849 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae406f160 con 0x7f3ae40c3060 2024-04-17T15:10:14.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.423+0000 7f3adb400640 1 --2- 172.21.15.16:0/2363913849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae40c3060 0x7f3ae40c87e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406f090 tx=0x7f3acc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02b2a1263051747 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3ae3400640 1 -- 172.21.15.16:0/2363913849 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0b5070 con 0x7f3ae40c3060 2024-04-17T15:10:14.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3ae3400640 1 -- 172.21.15.16:0/2363913849 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3acc0a8990 con 0x7f3ae40c3060 2024-04-17T15:10:14.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3ae3400640 1 -- 172.21.15.16:0/2363913849 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0a8d60 con 0x7f3ae40c3060 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2363913849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae40c3060 msgr2=0x7f3ae40c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2363913849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae40c3060 0x7f3ae40c87e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406f090 tx=0x7f3acc01ec90 comp rx=0 tx=0).stop 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2363913849 shutdown_connections 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2363913849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae40c3060 0x7f3ae40c87e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2363913849 >> 172.21.15.16:0/2363913849 conn(0x7f3ae406ba30 msgr2=0x7f3ae406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2363913849 shutdown_connections 2024-04-17T15:10:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.427+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2363913849 wait complete. 2024-04-17T15:10:14.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 Processor -- start 2024-04-17T15:10:14.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 -- start start 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ae40c3060 0x7f3ae4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ae40c8d20 0x7f3ae40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae406f720 con 0x7f3ae4153050 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae406ff20 con 0x7f3ae40c8d20 2024-04-17T15:10:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3aeaa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae406fa00 con 0x7f3ae40c3060 2024-04-17T15:10:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3ae8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3ae8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39778/0 (socket says 172.21.15.16:39778) 2024-04-17T15:10:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3ae8a00640 1 -- 172.21.15.16:0/2632189768 learned_addr learned my addr 172.21.15.16:0/2632189768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3adb400640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ae40c8d20 0x7f3ae40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.431+0000 7f3ae3e00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ae40c3060 0x7f3ae4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.435+0000 7f3ae8a00640 1 -- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ae40c3060 msgr2=0x7f3ae4157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.435+0000 7f3ae8a00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ae40c3060 0x7f3ae4157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.435+0000 7f3ae8a00640 1 -- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ae40c8d20 msgr2=0x7f3ae40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.435+0000 7f3ae8a00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ae40c8d20 0x7f3ae40cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.435+0000 7f3ae8a00640 1 -- 172.21.15.16:0/2632189768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4157880 con 0x7f3ae4153050 2024-04-17T15:10:14.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.439+0000 7f3ae8a00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00c7a0 tx=0x7f3adc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc003b80 con 0x7f3ae4153050 2024-04-17T15:10:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3adc003d20 con 0x7f3ae4153050 2024-04-17T15:10:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00aa30 con 0x7f3ae4153050 2024-04-17T15:10:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae4157b20 con 0x7f3ae4153050 2024-04-17T15:10:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae41f1220 con 0x7f3ae4153050 2024-04-17T15:10:14.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.443+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae4076280 con 0x7f3ae4153050 2024-04-17T15:10:14.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.463+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3adc00abd0 con 0x7f3ae4153050 2024-04-17T15:10:14.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.463+0000 7f3ae0c00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 0x7f3ac006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:14.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.467+0000 7f3ae3e00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 0x7f3ac006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:14.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.467+0000 7f3ae3e00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 0x7f3ac006a8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4005890 tx=0x7f3ad4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:14.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.723+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f3adc0551f0 con 0x7f3ae4153050 2024-04-17T15:10:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.723+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3adc057150 con 0x7f3ae4153050 2024-04-17T15:10:14.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.887+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3ae40c7cb0 con 0x7f3ac0068400 2024-04-17T15:10:14.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3ae0c00640 1 -- 172.21.15.16:0/2632189768 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3ae40c7cb0 con 0x7f3ac0068400 2024-04-17T15:10:14.891 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 msgr2=0x7f3ac006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 0x7f3ac006a8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4005890 tx=0x7f3ad4009040 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 msgr2=0x7f3ae40ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00c7a0 tx=0x7f3adc00cc60 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 shutdown_connections 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f3ac0068400 0x7f3ac006a8c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae4153050 0x7f3ae40ca270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ae40c8d20 0x7f3ae40cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 --2- 172.21.15.16:0/2632189768 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ae40c3060 0x7f3ae4157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 >> 172.21.15.16:0/2632189768 conn(0x7f3ae406ba30 msgr2=0x7f3ae40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 shutdown_connections 2024-04-17T15:10:14.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:14.891+0000 7f3aeaa00640 1 -- 172.21.15.16:0/2632189768 wait complete. 2024-04-17T15:10:14.912 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T15:10:14.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:15.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.055+0000 7efec5400640 1 Processor -- start 2024-04-17T15:10:15.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.055+0000 7efec5400640 1 -- start start 2024-04-17T15:10:15.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efec5400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec0153330 0x7efec00c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efec5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efec00c38e0 0x7efec00c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efec5400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec00c4270 con 0x7efec0159960 2024-04-17T15:10:15.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efec5400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efec00c8b40 con 0x7efec00c38e0 2024-04-17T15:10:15.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efec5400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7efec00c8e20 con 0x7efec0153330 2024-04-17T15:10:15.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efebe800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec0153330 0x7efec00c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efebf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efec00c38e0 0x7efec00c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efebf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efec00c38e0 0x7efec00c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39788/0 (socket says 172.21.15.16:39788) 2024-04-17T15:10:15.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.059+0000 7efebf200640 1 -- 172.21.15.16:0/3652126076 learned_addr learned my addr 172.21.15.16:0/3652126076 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:15.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.063+0000 7efebf200640 1 -- 172.21.15.16:0/3652126076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec0153330 msgr2=0x7efec00c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:15.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.063+0000 7efebf200640 1 --2- 172.21.15.16:0/3652126076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec0153330 0x7efec00c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.063+0000 7efebf200640 1 -- 172.21.15.16:0/3652126076 >> v1:172.21.15.16:6789/0 conn(0x7efec0159960 legacy=0x7efec006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.063+0000 7efebf200640 1 -- 172.21.15.16:0/3652126076 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec00c9100 con 0x7efec00c38e0 2024-04-17T15:10:15.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.067+0000 7efebf200640 1 --2- 172.21.15.16:0/3652126076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec00c38e0 0x7efec00c3d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009e50 tx=0x7efeb801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f3d4fde87bf1ce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.071+0000 7efebde00640 1 -- 172.21.15.16:0/3652126076 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80b4070 con 0x7efec00c38e0 2024-04-17T15:10:15.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.071+0000 7efebde00640 1 -- 172.21.15.16:0/3652126076 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb80af400 con 0x7efec00c38e0 2024-04-17T15:10:15.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.071+0000 7efebde00640 1 -- 172.21.15.16:0/3652126076 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80af7d0 con 0x7efec00c38e0 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- 172.21.15.16:0/3652126076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec00c38e0 msgr2=0x7efec00c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- 172.21.15.16:0/3652126076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec00c38e0 0x7efec00c3d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009e50 tx=0x7efeb801f210 comp rx=0 tx=0).stop 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- 172.21.15.16:0/3652126076 shutdown_connections 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- 172.21.15.16:0/3652126076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec00c38e0 0x7efec00c3d30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- 172.21.15.16:0/3652126076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec0153330 0x7efec00c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- 172.21.15.16:0/3652126076 >> 172.21.15.16:0/3652126076 conn(0x7efec006ba30 msgr2=0x7efec006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:15.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- 172.21.15.16:0/3652126076 shutdown_connections 2024-04-17T15:10:15.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- 172.21.15.16:0/3652126076 wait complete. 2024-04-17T15:10:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 Processor -- start 2024-04-17T15:10:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- start start 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec00c38e0 0x7efec01f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efec0153330 0x7efec014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec0159960 0x7efec015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efec0159dc0 con 0x7efec0159960 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efec00c96c0 con 0x7efec0153330 2024-04-17T15:10:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.075+0000 7efec5400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7efec006fc50 con 0x7efec00c38e0 2024-04-17T15:10:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.079+0000 7efebe800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec00c38e0 0x7efec01f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.079+0000 7efeb5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efec0153330 0x7efec014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.079+0000 7efebe800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec00c38e0 0x7efec01f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.16:49802/0 (socket says 172.21.15.16:49802) 2024-04-17T15:10:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.079+0000 7efebe800640 1 -- 172.21.15.16:0/2187818931 learned_addr learned my addr 172.21.15.16:0/2187818931 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.083+0000 7efebf200640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec0159960 0x7efec015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.091+0000 7efeb5e00640 1 -- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec00c38e0 msgr2=0x7efec01f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.091+0000 7efeb5e00640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efec00c38e0 0x7efec01f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.091+0000 7efeb5e00640 1 -- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec0159960 msgr2=0x7efec015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.091+0000 7efeb5e00640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efec0159960 0x7efec015bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.091+0000 7efeb5e00640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec014a290 con 0x7efec0153330 2024-04-17T15:10:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.095+0000 7efeb5e00640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efec0153330 0x7efec014bf80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efea800c3f0 tx=0x7efea800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.119+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea80052d0 con 0x7efec0153330 2024-04-17T15:10:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.119+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec014a550 con 0x7efec0153330 2024-04-17T15:10:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.119+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec015b7f0 con 0x7efec0153330 2024-04-17T15:10:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.119+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efec015b300 con 0x7efec0153330 2024-04-17T15:10:15.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.275+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec015b300 con 0x7efec0153330 2024-04-17T15:10:15.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.275+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8020060 con 0x7efec0153330 2024-04-17T15:10:15.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.279+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efea80072a0 con 0x7efec0153330 2024-04-17T15:10:15.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.279+0000 7efeb7400640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7efe9c0683b0 0x7efe9c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.279+0000 7efebe800640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7efe9c0683b0 0x7efe9c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.279+0000 7efebe800640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7efe9c0683b0 0x7efe9c06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efeb000ab90 tx=0x7efeb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.291+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7efea8054630 con 0x7efec0153330 2024-04-17T15:10:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.291+0000 7efeb7400640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7efe9c070610 0x7efe9c072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.291+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efea800ee50 con 0x7efe9c070610 2024-04-17T15:10:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.295+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efea8052830 con 0x7efec0153330 2024-04-17T15:10:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.295+0000 7efebf200640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7efe9c070610 0x7efe9c072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.295+0000 7efebf200640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7efe9c070610 0x7efe9c072a30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.295+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== osd.2 v2:172.21.15.16:6800/2077249539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efea800ee50 con 0x7efe9c070610 2024-04-17T15:10:15.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.307+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 --> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efec0076280 con 0x7efe9c070610 2024-04-17T15:10:15.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.307+0000 7efeb7400640 1 -- 172.21.15.16:0/2187818931 <== osd.2 v2:172.21.15.16:6800/2077249539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efec0076280 con 0x7efe9c070610 2024-04-17T15:10:15.309 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:15.310 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:15.310 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:15.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7efe9c070610 msgr2=0x7efe9c072a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.16:6800/2077249539,v1:172.21.15.16:6801/2077249539] conn(0x7efe9c070610 0x7efe9c072a30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7efe9c0683b0 msgr2=0x7efe9c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7efe9c0683b0 0x7efe9c06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efeb000ab90 tx=0x7efeb0008040 comp rx=0 tx=0).stop 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efec0153330 msgr2=0x7efec014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 --2- 172.21.15.16:0/2187818931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efec0153330 0x7efec014bf80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efea800c3f0 tx=0x7efea800c8b0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efebf200640 1 -- 172.21.15.16:0/2187818931 reap_dead start 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 shutdown_connections 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 >> 172.21.15.16:0/2187818931 conn(0x7efec006ba30 msgr2=0x7efec0152350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 shutdown_connections 2024-04-17T15:10:15.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.311+0000 7efec5400640 1 -- 172.21.15.16:0/2187818931 wait complete. 2024-04-17T15:10:15.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T15:10:15.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 Processor -- start 2024-04-17T15:10:15.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 -- start start 2024-04-17T15:10:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b24153050 0x7f4b24159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b240c3060 0x7f4b240c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b24153430 con 0x7f4b240c8d20 2024-04-17T15:10:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2406ef10 con 0x7f4b24153050 2024-04-17T15:10:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b2c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2406ff20 con 0x7f4b240c3060 2024-04-17T15:10:15.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b29000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b240c3060 0x7f4b240c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.471+0000 7f4b29a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b24153050 0x7f4b24159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.475+0000 7f4b29a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b24153050 0x7f4b24159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:57028/0 (socket says 172.21.15.16:57028) 2024-04-17T15:10:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.475+0000 7f4b29a00640 1 -- 172.21.15.16:0/2418825843 learned_addr learned my addr 172.21.15.16:0/2418825843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.475+0000 7f4b23e00640 1 -- 172.21.15.16:0/2418825843 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501228303 0 0) 0x7f4b24153430 con 0x7f4b240c8d20 2024-04-17T15:10:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.475+0000 7f4b23e00640 1 -- 172.21.15.16:0/2418825843 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b0c003530 con 0x7f4b240c8d20 2024-04-17T15:10:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.479+0000 7f4b29a00640 1 -- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b240c3060 msgr2=0x7f4b240c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.479+0000 7f4b29a00640 1 --2- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b240c3060 0x7f4b240c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.479+0000 7f4b29a00640 1 -- 172.21.15.16:0/2418825843 >> v1:172.21.15.16:6789/0 conn(0x7f4b240c8d20 legacy=0x7f4b240c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.479+0000 7f4b29a00640 1 -- 172.21.15.16:0/2418825843 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b24159cc0 con 0x7f4b24153050 2024-04-17T15:10:15.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.487+0000 7f4b29a00640 1 --2- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b24153050 0x7f4b24159780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b1801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48cb70d725c3cea server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.495+0000 7f4b23e00640 1 -- 172.21.15.16:0/2418825843 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b5070 con 0x7f4b24153050 2024-04-17T15:10:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.495+0000 7f4b23e00640 1 -- 172.21.15.16:0/2418825843 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b180a8a50 con 0x7f4b24153050 2024-04-17T15:10:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.495+0000 7f4b23e00640 1 -- 172.21.15.16:0/2418825843 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b180a8e20 con 0x7f4b24153050 2024-04-17T15:10:15.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b24153050 msgr2=0x7f4b24159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b24153050 0x7f4b24159780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b1801ed50 comp rx=0 tx=0).stop 2024-04-17T15:10:15.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- 172.21.15.16:0/2418825843 shutdown_connections 2024-04-17T15:10:15.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b240c3060 0x7f4b240c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- 172.21.15.16:0/2418825843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b24153050 0x7f4b24159780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- 172.21.15.16:0/2418825843 >> 172.21.15.16:0/2418825843 conn(0x7f4b2406ba30 msgr2=0x7f4b2406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:15.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- 172.21.15.16:0/2418825843 shutdown_connections 2024-04-17T15:10:15.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- 172.21.15.16:0/2418825843 wait complete. 2024-04-17T15:10:15.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 Processor -- start 2024-04-17T15:10:15.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- start start 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b240c3060 0x7f4b241f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b24153050 0x7f4b240cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2406f440 con 0x7f4b240c8d20 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2406f160 con 0x7f4b240c3060 2024-04-17T15:10:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.499+0000 7f4b2c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2406f720 con 0x7f4b24153050 2024-04-17T15:10:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b29000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b29000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39804/0 (socket says 172.21.15.16:39804) 2024-04-17T15:10:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b29000640 1 -- 172.21.15.16:0/4128488389 learned_addr learned my addr 172.21.15.16:0/4128488389 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b2a400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b24153050 0x7f4b240cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b29a00640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b240c3060 0x7f4b241f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.503+0000 7f4b29000640 1 -- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b24153050 msgr2=0x7f4b240cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.507+0000 7f4b29000640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b24153050 0x7f4b240cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.507+0000 7f4b29000640 1 -- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b240c3060 msgr2=0x7f4b241f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.507+0000 7f4b29000640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b240c3060 0x7f4b241f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.507+0000 7f4b29000640 1 -- 172.21.15.16:0/4128488389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b24158210 con 0x7f4b240c8d20 2024-04-17T15:10:15.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.507+0000 7f4b29000640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000e930 tx=0x7f4b1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10017070 con 0x7f4b240c8d20 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1000ca00 con 0x7f4b240c8d20 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000cdb0 con 0x7f4b240c8d20 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b240cc0c0 con 0x7f4b240c8d20 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b24156b70 con 0x7f4b240c8d20 2024-04-17T15:10:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.511+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b24076280 con 0x7f4b240c8d20 2024-04-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.779+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b1001a070 con 0x7f4b240c8d20 2024-04-17T15:10:15.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.779+0000 7f4b21600640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 0x7f4b0406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:15.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.779+0000 7f4b29a00640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 0x7f4b0406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:15.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.783+0000 7f4b29a00640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 0x7f4b0406a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b2000 tx=0x7f4b180aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:15.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.795+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4b10055250 con 0x7f4b240c8d20 2024-04-17T15:10:15.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.795+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4b100571b0 con 0x7f4b240c8d20 2024-04-17T15:10:15.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.959+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4b240c7cb0 con 0x7f4b040683d0 2024-04-17T15:10:15.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.959+0000 7f4b21600640 1 -- 172.21.15.16:0/4128488389 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4b240c7cb0 con 0x7f4b040683d0 2024-04-17T15:10:15.960 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 msgr2=0x7f4b0406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 0x7f4b0406a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b2000 tx=0x7f4b180aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 msgr2=0x7f4b240cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000e930 tx=0x7f4b1000edf0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 shutdown_connections 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f4b040683d0 0x7f4b0406a890 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b24153050 0x7f4b240cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b240c8d20 0x7f4b240cb410 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 --2- 172.21.15.16:0/4128488389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b240c3060 0x7f4b241f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:15.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 >> 172.21.15.16:0/4128488389 conn(0x7f4b2406ba30 msgr2=0x7f4b24074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:15.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 shutdown_connections 2024-04-17T15:10:15.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:15.963+0000 7f4b2c400640 1 -- 172.21.15.16:0/4128488389 wait complete. 2024-04-17T15:10:15.983 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T15:10:15.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:16.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.127+0000 7f7403200640 1 Processor -- start 2024-04-17T15:10:16.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.127+0000 7f7403200640 1 -- start start 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7404152ae0 0x7f74040c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8380 0x7f74040c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74040c8b70 0x7f74040cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7404152ec0 con 0x7f74040c8b70 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f74040c9120 con 0x7f7404152ae0 2024-04-17T15:10:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7403200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f7404158b30 con 0x7f74040c8380 2024-04-17T15:10:16.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7401e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7404152ae0 0x7f74040c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7401400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8380 0x7f74040c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7401e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7404152ae0 0x7f74040c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:57060/0 (socket says 172.21.15.16:57060) 2024-04-17T15:10:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.131+0000 7f7401e00640 1 -- 172.21.15.16:0/970664176 learned_addr learned my addr 172.21.15.16:0/970664176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:16.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.139+0000 7f7401e00640 1 -- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8380 msgr2=0x7f74040c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:16.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.139+0000 7f7401e00640 1 --2- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8380 0x7f74040c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.139+0000 7f7401e00640 1 -- 172.21.15.16:0/970664176 >> v2:172.21.15.16:3300/0 conn(0x7f74040c8b70 msgr2=0x7f74040cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:16.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.139+0000 7f7401e00640 1 --2- 172.21.15.16:0/970664176 >> v2:172.21.15.16:3300/0 conn(0x7f74040c8b70 0x7f74040cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.139+0000 7f7401e00640 1 -- 172.21.15.16:0/970664176 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7404158e10 con 0x7f7404152ae0 2024-04-17T15:10:16.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.143+0000 7f7401e00640 1 --2- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7404152ae0 0x7f74040c7340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74040708f0 tx=0x7f73f401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0d79e78f46f8328 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7400a00640 1 -- 172.21.15.16:0/970664176 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40b5070 con 0x7f7404152ae0 2024-04-17T15:10:16.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7400a00640 1 -- 172.21.15.16:0/970664176 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f40a89d0 con 0x7f7404152ae0 2024-04-17T15:10:16.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7400a00640 1 -- 172.21.15.16:0/970664176 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40a8da0 con 0x7f7404152ae0 2024-04-17T15:10:16.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 -- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7404152ae0 msgr2=0x7f74040c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 --2- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7404152ae0 0x7f74040c7340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74040708f0 tx=0x7f73f401ed10 comp rx=0 tx=0).stop 2024-04-17T15:10:16.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 -- 172.21.15.16:0/970664176 shutdown_connections 2024-04-17T15:10:16.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 --2- 172.21.15.16:0/970664176 >> v2:172.21.15.16:3300/0 conn(0x7f74040c8b70 0x7f74040cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 --2- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8380 0x7f74040c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 --2- 172.21.15.16:0/970664176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7404152ae0 0x7f74040c7340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 -- 172.21.15.16:0/970664176 >> 172.21.15.16:0/970664176 conn(0x7f740406fb40 msgr2=0x7f740406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:16.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 -- 172.21.15.16:0/970664176 shutdown_connections 2024-04-17T15:10:16.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.155+0000 7f7403200640 1 -- 172.21.15.16:0/970664176 wait complete. 2024-04-17T15:10:16.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 Processor -- start 2024-04-17T15:10:16.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 -- start start 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74040c8380 0x7f7404146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8b70 0x7f7404155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 0x7f74041f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74040c3f20 con 0x7f7404152ae0 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f74041593d0 con 0x7f74040c8380 2024-04-17T15:10:16.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7403200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f74040c6c30 con 0x7f74040c8b70 2024-04-17T15:10:16.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7402800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 0x7f74041f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7402800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 0x7f74041f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39826/0 (socket says 172.21.15.16:39826) 2024-04-17T15:10:16.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.159+0000 7f7402800640 1 -- 172.21.15.16:0/1490463426 learned_addr learned my addr 172.21.15.16:0/1490463426 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:16.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.163+0000 7f7402800640 1 -- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8b70 msgr2=0x7f7404155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.163+0000 7f7402800640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74040c8b70 0x7f7404155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.163+0000 7f7402800640 1 -- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74040c8380 msgr2=0x7f7404146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.163+0000 7f7402800640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74040c8380 0x7f7404146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.163+0000 7f7402800640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040caa00 con 0x7f7404152ae0 2024-04-17T15:10:16.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.167+0000 7f7402800640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 0x7f74041f3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b970 tx=0x7f73fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc019070 con 0x7f7404152ae0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73fc00cb60 con 0x7f7404152ae0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc014440 con 0x7f7404152ae0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7404147370 con 0x7f7404152ae0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7404147930 con 0x7f7404152ae0 2024-04-17T15:10:16.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.171+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74040761a0 con 0x7f7404152ae0 2024-04-17T15:10:16.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.191+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73fc01c070 con 0x7f7404152ae0 2024-04-17T15:10:16.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.191+0000 7f73fa000640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f73e40683d0 0x7f73e406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.191+0000 7f7401e00640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f73e40683d0 0x7f73e406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f7401e00640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f73e40683d0 0x7f73e406a890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f73f40b2000 tx=0x7f73f4004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f73fc054da0 con 0x7f7404152ae0 2024-04-17T15:10:16.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f73fa000640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f73e40705d0 0x7f73e40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73e40730c0 con 0x7f73e40705d0 2024-04-17T15:10:16.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73fc052fa0 con 0x7f7404152ae0 2024-04-17T15:10:16.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f7401400640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f73e40705d0 0x7f73e40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.195+0000 7f7401400640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f73e40705d0 0x7f73e40729f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.199+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== osd.3 v2:172.21.15.16:6816/274422145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73e40730c0 con 0x7f73e40705d0 2024-04-17T15:10:16.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 --> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74041563b0 con 0x7f73e40705d0 2024-04-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f73fa000640 1 -- 172.21.15.16:0/1490463426 <== osd.3 v2:172.21.15.16:6816/274422145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74041563b0 con 0x7f73e40705d0 2024-04-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:16.212 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f73e40705d0 msgr2=0x7f73e40729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:6816/274422145,v1:172.21.15.16:6817/274422145] conn(0x7f73e40705d0 0x7f73e40729f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f73e40683d0 msgr2=0x7f73e406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f73e40683d0 0x7f73e406a890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f73f40b2000 tx=0x7f73f4004740 comp rx=0 tx=0).stop 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 msgr2=0x7f74041f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 --2- 172.21.15.16:0/1490463426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7404152ae0 0x7f74041f3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b970 tx=0x7f73fc00be30 comp rx=0 tx=0).stop 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7402800640 1 -- 172.21.15.16:0/1490463426 reap_dead start 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 shutdown_connections 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 >> 172.21.15.16:0/1490463426 conn(0x7f740406fb40 msgr2=0x7f74040c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 shutdown_connections 2024-04-17T15:10:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.211+0000 7f7403200640 1 -- 172.21.15.16:0/1490463426 wait complete. 2024-04-17T15:10:16.231 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T15:10:16.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.371+0000 7fac2c200640 1 Processor -- start 2024-04-17T15:10:16.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 -- start start 2024-04-17T15:10:16.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac240c9a70 0x7fac240c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac240b14b0 0x7fac2415b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2415aed0 con 0x7fac240c9690 2024-04-17T15:10:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fac2415ebb0 con 0x7fac240b14b0 2024-04-17T15:10:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2c200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fac2415ee90 con 0x7fac240c9a70 2024-04-17T15:10:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac2a200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac240b14b0 0x7fac2415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac29800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fac240c9690 0x7fac240b0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53900/0 (socket says 172.21.15.16:53900) 2024-04-17T15:10:16.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.375+0000 7fac29800640 1 -- 172.21.15.16:0/1010666127 learned_addr learned my addr 172.21.15.16:0/1010666127 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:16.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.379+0000 7fac2a200640 1 -- 172.21.15.16:0/1010666127 >> v2:172.21.15.67:3300/0 conn(0x7fac240c9a70 msgr2=0x7fac240c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:16.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.379+0000 7fac2a200640 1 --2- 172.21.15.16:0/1010666127 >> v2:172.21.15.67:3300/0 conn(0x7fac240c9a70 0x7fac240c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.379+0000 7fac2a200640 1 -- 172.21.15.16:0/1010666127 >> v1:172.21.15.16:6789/0 conn(0x7fac240c9690 legacy=0x7fac240b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.379+0000 7fac2a200640 1 -- 172.21.15.16:0/1010666127 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2415f170 con 0x7fac240b14b0 2024-04-17T15:10:16.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.383+0000 7fac2a200640 1 --2- 172.21.15.16:0/1010666127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240b14b0 0x7fac2415b990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fac240b1ac0 tx=0x7fac1c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103b60bd13aaffef server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.387+0000 7fac23e00640 1 -- 172.21.15.16:0/1010666127 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0b2070 con 0x7fac240b14b0 2024-04-17T15:10:16.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.387+0000 7fac23e00640 1 -- 172.21.15.16:0/1010666127 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c0a5930 con 0x7fac240b14b0 2024-04-17T15:10:16.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.387+0000 7fac23e00640 1 -- 172.21.15.16:0/1010666127 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0a5d00 con 0x7fac240b14b0 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- 172.21.15.16:0/1010666127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240b14b0 msgr2=0x7fac2415b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- 172.21.15.16:0/1010666127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240b14b0 0x7fac2415b990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fac240b1ac0 tx=0x7fac1c01c870 comp rx=0 tx=0).stop 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- 172.21.15.16:0/1010666127 shutdown_connections 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- 172.21.15.16:0/1010666127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240b14b0 0x7fac2415b990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- 172.21.15.16:0/1010666127 >> v2:172.21.15.67:3300/0 conn(0x7fac240c9a70 0x7fac240c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- 172.21.15.16:0/1010666127 >> 172.21.15.16:0/1010666127 conn(0x7fac24062850 msgr2=0x7fac2406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- 172.21.15.16:0/1010666127 shutdown_connections 2024-04-17T15:10:16.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- 172.21.15.16:0/1010666127 wait complete. 2024-04-17T15:10:16.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 Processor -- start 2024-04-17T15:10:16.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- start start 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac240b14b0 0x7fac240c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac240c9690 0x7fac240ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac240c3670 con 0x7fac240c9a70 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac2415e850 con 0x7fac240c9690 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fac240c37f0 con 0x7fac240b14b0 2024-04-17T15:10:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.391+0000 7fac2a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39854/0 (socket says 172.21.15.16:39854) 2024-04-17T15:10:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 -- 172.21.15.16:0/3506715033 learned_addr learned my addr 172.21.15.16:0/3506715033 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 -- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac240b14b0 msgr2=0x7fac240c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac240b14b0 0x7fac240c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 -- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac240c9690 msgr2=0x7fac240ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac240c9690 0x7fac240ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.395+0000 7fac2a200640 1 -- 172.21.15.16:0/3506715033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2415c3e0 con 0x7fac240c9a70 2024-04-17T15:10:16.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.399+0000 7fac2a200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac1c01a4a0 tx=0x7fac1c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0b2050 con 0x7fac240c9a70 2024-04-17T15:10:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c0be070 con 0x7fac240c9a70 2024-04-17T15:10:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0adaf0 con 0x7fac240c9a70 2024-04-17T15:10:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2415c6c0 con 0x7fac240c9a70 2024-04-17T15:10:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac24152410 con 0x7fac240c9a70 2024-04-17T15:10:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.403+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac24076280 con 0x7fac240c9a70 2024-04-17T15:10:16.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.671+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac1c0adc90 con 0x7fac240c9a70 2024-04-17T15:10:16.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.671+0000 7fac21600640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 0x7fac0406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:16.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.671+0000 7fac29800640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 0x7fac0406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:16.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.671+0000 7fac29800640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 0x7fac0406a890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f70 tx=0x7fac18007a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:16.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.683+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fac1c0f07c0 con 0x7fac240c9a70 2024-04-17T15:10:16.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.683+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fac1c016520 con 0x7fac240c9a70 2024-04-17T15:10:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.855+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fac240cc340 con 0x7fac040683d0 2024-04-17T15:10:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.855+0000 7fac21600640 1 -- 172.21.15.16:0/3506715033 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac240cc340 con 0x7fac040683d0 2024-04-17T15:10:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T15:10:16.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 msgr2=0x7fac0406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 0x7fac0406a890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f70 tx=0x7fac18007a90 comp rx=0 tx=0).stop 2024-04-17T15:10:16.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 msgr2=0x7fac24150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:16.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac1c01a4a0 tx=0x7fac1c019610 comp rx=0 tx=0).stop 2024-04-17T15:10:16.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 shutdown_connections 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac040683d0 0x7fac0406a890 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac240c9a70 0x7fac24150060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac240c9690 0x7fac240ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 --2- 172.21.15.16:0/3506715033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac240b14b0 0x7fac240c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 >> 172.21.15.16:0/3506715033 conn(0x7fac24062850 msgr2=0x7fac240713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 shutdown_connections 2024-04-17T15:10:16.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:16.859+0000 7fac2c200640 1 -- 172.21.15.16:0/3506715033 wait complete. 2024-04-17T15:10:16.880 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T15:10:16.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:17.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.023+0000 7f0a2e400640 1 Processor -- start 2024-04-17T15:10:17.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.023+0000 7f0a2e400640 1 -- start start 2024-04-17T15:10:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.023+0000 7f0a2e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a28151cf0 0x7f0a280c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a2e400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a280c5920 0x7f0a280c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a2e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a28157e50 con 0x7f0a28071ac0 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a2e400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0a28158180 con 0x7f0a280c5920 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a2e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f0a280c5ef0 con 0x7f0a28151cf0 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a280c5920 0x7f0a280c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a280c5920 0x7f0a280c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39864/0 (socket says 172.21.15.16:39864) 2024-04-17T15:10:17.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 -- 172.21.15.16:0/3849275914 learned_addr learned my addr 172.21.15.16:0/3849275914 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:17.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27400640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a28151cf0 0x7f0a280c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 -- 172.21.15.16:0/3849275914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a28151cf0 msgr2=0x7f0a280c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a28151cf0 0x7f0a280c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 -- 172.21.15.16:0/3849275914 >> v1:172.21.15.67:6789/0 conn(0x7f0a28071ac0 legacy=0x7f0a28158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.027+0000 7f0a27e00640 1 -- 172.21.15.16:0/3849275914 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280c61d0 con 0x7f0a280c5920 2024-04-17T15:10:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.031+0000 7f0a27e00640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a280c5920 0x7f0a280c3800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009e50 tx=0x7f0a2001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee06bd6fc0e69705 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.035+0000 7f0a26a00640 1 -- 172.21.15.16:0/3849275914 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200b4070 con 0x7f0a280c5920 2024-04-17T15:10:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.035+0000 7f0a26a00640 1 -- 172.21.15.16:0/3849275914 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a200af400 con 0x7f0a280c5920 2024-04-17T15:10:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.035+0000 7f0a26a00640 1 -- 172.21.15.16:0/3849275914 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200af7d0 con 0x7f0a280c5920 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- 172.21.15.16:0/3849275914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a280c5920 msgr2=0x7f0a280c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a280c5920 0x7f0a280c3800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009e50 tx=0x7f0a2001f210 comp rx=0 tx=0).stop 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- 172.21.15.16:0/3849275914 shutdown_connections 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a280c5920 0x7f0a280c3800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- 172.21.15.16:0/3849275914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a28151cf0 0x7f0a280c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- 172.21.15.16:0/3849275914 >> 172.21.15.16:0/3849275914 conn(0x7f0a2806ba30 msgr2=0x7f0a2806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- 172.21.15.16:0/3849275914 shutdown_connections 2024-04-17T15:10:17.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- 172.21.15.16:0/3849275914 wait complete. 2024-04-17T15:10:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 Processor -- start 2024-04-17T15:10:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- start start 2024-04-17T15:10:17.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 0x7f0a281f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a280c5920 0x7f0a281f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a28151cf0 0x7f0a28155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0a281520d0 con 0x7f0a28071ac0 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a280c6790 con 0x7f0a28151cf0 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a2e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f0a28152250 con 0x7f0a280c5920 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.039+0000 7f0a27400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 0x7f0a281f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 0x7f0a281f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39874/0 (socket says 172.21.15.16:39874) 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 -- 172.21.15.16:0/2562226579 learned_addr learned my addr 172.21.15.16:0/2562226579 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a1fe00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a280c5920 0x7f0a281f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27e00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a28151cf0 0x7f0a28155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 -- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a280c5920 msgr2=0x7f0a281f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0a280c5920 0x7f0a281f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 -- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a28151cf0 msgr2=0x7f0a28155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a28151cf0 0x7f0a28155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.043+0000 7f0a27400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a281f4820 con 0x7f0a28071ac0 2024-04-17T15:10:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.047+0000 7f0a27400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 0x7f0a281f4200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800d5f0 tx=0x7f0a1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180125f0 con 0x7f0a28071ac0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a18019070 con 0x7f0a28071ac0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180129b0 con 0x7f0a28071ac0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a281f50a0 con 0x7f0a28071ac0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281f4dc0 con 0x7f0a28071ac0 2024-04-17T15:10:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.051+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a28076280 con 0x7f0a28071ac0 2024-04-17T15:10:17.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a18012b50 con 0x7f0a28071ac0 2024-04-17T15:10:17.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0a040683d0 0x7f0a0406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1fe00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0a040683d0 0x7f0a0406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1fe00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0a040683d0 0x7f0a0406a890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a28148ca0 tx=0x7f0a10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0a18012e40 con 0x7f0a28071ac0 2024-04-17T15:10:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7f0a040705d0 0x7f0a040729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a18006820 con 0x7f0a040705d0 2024-04-17T15:10:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.075+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a18053910 con 0x7f0a28071ac0 2024-04-17T15:10:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.079+0000 7f0a27e00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7f0a040705d0 0x7f0a040729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.079+0000 7f0a27e00640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7f0a040705d0 0x7f0a040729f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.079+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== osd.4 v2:172.21.15.67:6818/2915598098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a18006820 con 0x7f0a040705d0 2024-04-17T15:10:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.091+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 --> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a280c8a60 con 0x7f0a040705d0 2024-04-17T15:10:17.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a1f400640 1 -- 172.21.15.16:0/2562226579 <== osd.4 v2:172.21.15.67:6818/2915598098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0a280c8a60 con 0x7f0a040705d0 2024-04-17T15:10:17.095 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:17.095 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:17.095 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7f0a040705d0 msgr2=0x7f0a040729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6818/2915598098,v1:172.21.15.67:6819/2915598098] conn(0x7f0a040705d0 0x7f0a040729f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0a040683d0 msgr2=0x7f0a0406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f0a040683d0 0x7f0a0406a890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a28148ca0 tx=0x7f0a10009040 comp rx=0 tx=0).stop 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 msgr2=0x7f0a281f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 --2- 172.21.15.16:0/2562226579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a28071ac0 0x7f0a281f4200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800d5f0 tx=0x7f0a1800dab0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a27e00640 1 -- 172.21.15.16:0/2562226579 reap_dead start 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 shutdown_connections 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 >> 172.21.15.16:0/2562226579 conn(0x7f0a2806ba30 msgr2=0x7f0a281491f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 shutdown_connections 2024-04-17T15:10:17.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.095+0000 7f0a2e400640 1 -- 172.21.15.16:0/2562226579 wait complete. 2024-04-17T15:10:17.114 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T15:10:17.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 Processor -- start 2024-04-17T15:10:17.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 -- start start 2024-04-17T15:10:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0064154f30 0x7f006415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 0x7f006406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006415bbf0 con 0x7f0064072ac0 2024-04-17T15:10:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0064155310 con 0x7f0064154f30 2024-04-17T15:10:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.255+0000 7f0069600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f00640c8d30 con 0x7f006406f520 2024-04-17T15:10:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f005be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0064072ac0 0x7f0064072f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53916/0 (socket says 172.21.15.16:53916) 2024-04-17T15:10:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f005be00640 1 -- 172.21.15.16:0/3955867378 learned_addr learned my addr 172.21.15.16:0/3955867378 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f0062a00640 1 --2- 172.21.15.16:0/3955867378 >> v2:172.21.15.67:3300/0 conn(0x7f0064154f30 0x7f006415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f0063400640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 0x7f006406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579154979 0 0) 0x7f006415bbf0 con 0x7f0064072ac0 2024-04-17T15:10:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.259+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0048003530 con 0x7f0064072ac0 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1558630481 0 0) 0x7f0048003530 con 0x7f0064072ac0 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 msgr2=0x7f006406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 0x7f006406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 >> v2:172.21.15.67:3300/0 conn(0x7f0064154f30 msgr2=0x7f006415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 --2- 172.21.15.16:0/3955867378 >> v2:172.21.15.67:3300/0 conn(0x7f0064154f30 0x7f006415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00640c9010 con 0x7f0064072ac0 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f004c001680 con 0x7f0064072ac0 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 >> v1:172.21.15.16:6789/0 conn(0x7f0064072ac0 legacy=0x7f0064072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00480039c0 0x7f0048003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 0x7f0048004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0048004d50 0x7f00480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0064155310 con 0x7f0048004d50 2024-04-17T15:10:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00640c8d30 con 0x7f00480039c0 2024-04-17T15:10:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.263+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f004800ba00 con 0x7f006406f520 2024-04-17T15:10:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.267+0000 7f0063400640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0048004d50 0x7f00480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.271+0000 7f0063400640 1 -- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 msgr2=0x7f0048004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.271+0000 7f0063400640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006406f520 0x7f0048004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.271+0000 7f0063400640 1 -- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00480039c0 msgr2=0x7f0048003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.271+0000 7f0063400640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00480039c0 0x7f0048003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.271+0000 7f0063400640 1 -- 172.21.15.16:0/3955867378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0048003530 con 0x7f0048004d50 2024-04-17T15:10:17.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.275+0000 7f0063400640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0048004d50 0x7f00480051d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f005c009fc0 tx=0x7f005c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b95388bd54bcbb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0b2070 con 0x7f0048004d50 2024-04-17T15:10:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0a5cd0 con 0x7f0048004d50 2024-04-17T15:10:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0062000640 1 -- 172.21.15.16:0/3955867378 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c009c10 con 0x7f0048004d50 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- 172.21.15.16:0/3955867378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0048004d50 msgr2=0x7f00480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 --2- 172.21.15.16:0/3955867378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0048004d50 0x7f00480051d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f005c009fc0 tx=0x7f005c01ccc0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0063400640 1 -- 172.21.15.16:0/3955867378 reap_dead start 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- 172.21.15.16:0/3955867378 shutdown_connections 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- 172.21.15.16:0/3955867378 >> 172.21.15.16:0/3955867378 conn(0x7f006406ba30 msgr2=0x7f006406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- 172.21.15.16:0/3955867378 shutdown_connections 2024-04-17T15:10:17.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- 172.21.15.16:0/3955867378 wait complete. 2024-04-17T15:10:17.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 Processor -- start 2024-04-17T15:10:17.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.295+0000 7f0069600640 1 -- start start 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0048004d50 0x7f00641f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415e0e0 0x7f00640ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f00640c98b0 con 0x7f006414bb70 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00640c95d0 con 0x7f0048004d50 2024-04-17T15:10:17.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0069600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f00640c8960 con 0x7f006415e0e0 2024-04-17T15:10:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.299+0000 7f0063400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.303+0000 7f0063400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39890/0 (socket says 172.21.15.16:39890) 2024-04-17T15:10:17.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.303+0000 7f0063400640 1 -- 172.21.15.16:0/2584068488 learned_addr learned my addr 172.21.15.16:0/2584068488 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:17.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.303+0000 7f005be00640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415e0e0 0x7f00640ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 -- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415e0e0 msgr2=0x7f00640ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415e0e0 0x7f00640ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 -- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0048004d50 msgr2=0x7f00641f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0048004d50 0x7f00641f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 -- 172.21.15.16:0/2584068488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006415d8f0 con 0x7f006414bb70 2024-04-17T15:10:17.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.307+0000 7f0063400640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f005c0b0040 tx=0x7f005c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.311+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0bd070 con 0x7f006414bb70 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.311+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0a5ad0 con 0x7f006414bb70 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.311+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0b2040 con 0x7f006414bb70 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.311+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006415db90 con 0x7f006414bb70 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.311+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00641f3d50 con 0x7f006414bb70 2024-04-17T15:10:17.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.315+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00640c6ca0 con 0x7f006414bb70 2024-04-17T15:10:17.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.335+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f005c0c0070 con 0x7f006414bb70 2024-04-17T15:10:17.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.335+0000 7f005aa00640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 0x7f004006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.339+0000 7f0062a00640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 0x7f004006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.339+0000 7f0062a00640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 0x7f004006a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0054006aa0 tx=0x7f0054004780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.339+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f005c0a5c80 con 0x7f006414bb70 2024-04-17T15:10:17.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.599+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f005c0c7020 con 0x7f006414bb70 2024-04-17T15:10:17.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.767+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f00640cd4d0 con 0x7f00400683d0 2024-04-17T15:10:17.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.767+0000 7f005aa00640 1 -- 172.21.15.16:0/2584068488 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f00640cd4d0 con 0x7f00400683d0 2024-04-17T15:10:17.769 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T15:10:17.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 msgr2=0x7f004006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 0x7f004006a890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0054006aa0 tx=0x7f0054004780 comp rx=0 tx=0).stop 2024-04-17T15:10:17.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 msgr2=0x7f006414bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f005c0b0040 tx=0x7f005c009750 comp rx=0 tx=0).stop 2024-04-17T15:10:17.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 shutdown_connections 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f00400683d0 0x7f004006a890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f006414bb70 0x7f006414bff0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f006415e0e0 0x7f00640ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 --2- 172.21.15.16:0/2584068488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0048004d50 0x7f00641f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 >> 172.21.15.16:0/2584068488 conn(0x7f006406ba30 msgr2=0x7f00640c3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 shutdown_connections 2024-04-17T15:10:17.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.771+0000 7f0069600640 1 -- 172.21.15.16:0/2584068488 wait complete. 2024-04-17T15:10:17.792 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T15:10:17.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:17.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 Processor -- start 2024-04-17T15:10:17.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 -- start start 2024-04-17T15:10:17.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa960153330 0x7fa9600c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960159960 0x7fa96006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9600c8b40 con 0x7fa96006fa80 2024-04-17T15:10:17.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa9600c8e20 con 0x7fa960153330 2024-04-17T15:10:17.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa965000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa9600c9100 con 0x7fa960159960 2024-04-17T15:10:17.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.939+0000 7fa95de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa960153330 0x7fa9600c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.943+0000 7fa95d400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960159960 0x7fa96006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.943+0000 7fa95de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa960153330 0x7fa9600c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.16:57150/0 (socket says 172.21.15.16:57150) 2024-04-17T15:10:17.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.943+0000 7fa95de00640 1 -- 172.21.15.16:0/523674694 learned_addr learned my addr 172.21.15.16:0/523674694 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.947+0000 7fa95de00640 1 -- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960159960 msgr2=0x7fa96006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.947+0000 7fa95de00640 1 --2- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960159960 0x7fa96006f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.947+0000 7fa95de00640 1 -- 172.21.15.16:0/523674694 >> v1:172.21.15.67:6789/0 conn(0x7fa96006fa80 legacy=0x7fa9600c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.947+0000 7fa95de00640 1 -- 172.21.15.16:0/523674694 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9600c93e0 con 0x7fa960153330 2024-04-17T15:10:17.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.959+0000 7fa95de00640 1 --2- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960153330 0x7fa9600c7090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa950009870 tx=0x7fa95001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64cc1cb115b08dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa95ca00640 1 -- 172.21.15.16:0/523674694 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9500b5070 con 0x7fa960153330 2024-04-17T15:10:17.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa95ca00640 1 -- 172.21.15.16:0/523674694 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9500a89d0 con 0x7fa960153330 2024-04-17T15:10:17.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa95ca00640 1 -- 172.21.15.16:0/523674694 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a8da0 con 0x7fa960153330 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960153330 msgr2=0x7fa9600c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960153330 0x7fa9600c7090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa950009870 tx=0x7fa95001ed10 comp rx=0 tx=0).stop 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- 172.21.15.16:0/523674694 shutdown_connections 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960159960 0x7fa96006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- 172.21.15.16:0/523674694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa960153330 0x7fa9600c7090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- 172.21.15.16:0/523674694 >> 172.21.15.16:0/523674694 conn(0x7fa96006ba30 msgr2=0x7fa96006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- 172.21.15.16:0/523674694 shutdown_connections 2024-04-17T15:10:17.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- 172.21.15.16:0/523674694 wait complete. 2024-04-17T15:10:17.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 Processor -- start 2024-04-17T15:10:17.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- start start 2024-04-17T15:10:17.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96006fa80 0x7fa9601526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960153330 0x7fa9601e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 0x7fa9601e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600700f0 con 0x7fa960159960 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa960159dc0 con 0x7fa96006fa80 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.971+0000 7fa965000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fa960070270 con 0x7fa960153330 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.975+0000 7fa95e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 0x7fa9601e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.975+0000 7fa95e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 0x7fa9601e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39892/0 (socket says 172.21.15.16:39892) 2024-04-17T15:10:17.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.975+0000 7fa95e800640 1 -- 172.21.15.16:0/2806290669 learned_addr learned my addr 172.21.15.16:0/2806290669 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:17.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.975+0000 7fa95d400640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960153330 0x7fa9601e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.975+0000 7fa95de00640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96006fa80 0x7fa9601526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:17.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 -- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960153330 msgr2=0x7fa9601e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa960153330 0x7fa9601e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 -- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96006fa80 msgr2=0x7fa9601526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:17.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa96006fa80 0x7fa9601526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:17.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601f1240 con 0x7fa960159960 2024-04-17T15:10:17.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.979+0000 7fa95e800640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 0x7fa9601e66d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c780 tx=0x7fa95800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958017070 con 0x7fa960159960 2024-04-17T15:10:17.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958003db0 con 0x7fa960159960 2024-04-17T15:10:17.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9580052b0 con 0x7fa960159960 2024-04-17T15:10:17.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9601f5260 con 0x7fa960159960 2024-04-17T15:10:17.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9601f1500 con 0x7fa960159960 2024-04-17T15:10:17.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:17.983+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa960076280 con 0x7fa960159960 2024-04-17T15:10:18.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa95801a070 con 0x7fa960159960 2024-04-17T15:10:18.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa95de00640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa958054710 con 0x7fa960159960 2024-04-17T15:10:18.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7fa940070630 0x7fa940072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa940073120 con 0x7fa940070630 2024-04-17T15:10:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa95de00640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b2000 tx=0x7fa9500aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa95d400640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7fa940070630 0x7fa940072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa958052910 con 0x7fa960159960 2024-04-17T15:10:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.007+0000 7fa95d400640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7fa940070630 0x7fa940072a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.011+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== osd.5 v2:172.21.15.67:6810/1857257902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa940073120 con 0x7fa940070630 2024-04-17T15:10:18.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.023+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 --> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa960149530 con 0x7fa940070630 2024-04-17T15:10:18.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.023+0000 7fa956000640 1 -- 172.21.15.16:0/2806290669 <== osd.5 v2:172.21.15.67:6810/1857257902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa960149530 con 0x7fa940070630 2024-04-17T15:10:18.026 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:18.026 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7fa940070630 msgr2=0x7fa940072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6810/1857257902,v1:172.21.15.67:6811/1857257902] conn(0x7fa940070630 0x7fa940072a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 msgr2=0x7fa94006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fa9400683d0 0x7fa94006a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b2000 tx=0x7fa9500aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 msgr2=0x7fa9601e66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 --2- 172.21.15.16:0/2806290669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa960159960 0x7fa9601e66d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c780 tx=0x7fa95800cc40 comp rx=0 tx=0).stop 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa95e800640 1 -- 172.21.15.16:0/2806290669 reap_dead start 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 shutdown_connections 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 >> 172.21.15.16:0/2806290669 conn(0x7fa96006ba30 msgr2=0x7fa960158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 shutdown_connections 2024-04-17T15:10:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.027+0000 7fa965000640 1 -- 172.21.15.16:0/2806290669 wait complete. 2024-04-17T15:10:18.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T15:10:18.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 Processor -- start 2024-04-17T15:10:18.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 -- start start 2024-04-17T15:10:18.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feabc153050 0x7feabc159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feabc0c3970 0x7feabc0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feabc153430 con 0x7feabc0c3060 2024-04-17T15:10:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7feabc06ef10 con 0x7feabc153050 2024-04-17T15:10:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feac1000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7feabc06ff20 con 0x7feabc0c3970 2024-04-17T15:10:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feab9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feabc153050 0x7feabc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feab3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feabc0c3060 0x7feabc0c87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53928/0 (socket says 172.21.15.16:53928) 2024-04-17T15:10:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feab3e00640 1 -- 172.21.15.16:0/2211785901 learned_addr learned my addr 172.21.15.16:0/2211785901 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:18.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.187+0000 7feaba800640 1 --2- 172.21.15.16:0/2211785901 >> v2:172.21.15.67:3300/0 conn(0x7feabc0c3970 0x7feabc0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.191+0000 7feab9e00640 1 -- 172.21.15.16:0/2211785901 >> v2:172.21.15.67:3300/0 conn(0x7feabc0c3970 msgr2=0x7feabc0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.191+0000 7feab9e00640 1 --2- 172.21.15.16:0/2211785901 >> v2:172.21.15.67:3300/0 conn(0x7feabc0c3970 0x7feabc0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.191+0000 7feab9e00640 1 -- 172.21.15.16:0/2211785901 >> v1:172.21.15.16:6789/0 conn(0x7feabc0c3060 legacy=0x7feabc0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.191+0000 7feab9e00640 1 -- 172.21.15.16:0/2211785901 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc159cc0 con 0x7feabc153050 2024-04-17T15:10:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.203+0000 7feab9e00640 1 --2- 172.21.15.16:0/2211785901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc159780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feabc071970 tx=0x7feaac01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62faf5a0883dcfab server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feab9400640 1 -- 172.21.15.16:0/2211785901 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0b5070 con 0x7feabc153050 2024-04-17T15:10:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feab9400640 1 -- 172.21.15.16:0/2211785901 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0a8970 con 0x7feabc153050 2024-04-17T15:10:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feab9400640 1 -- 172.21.15.16:0/2211785901 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a8d40 con 0x7feabc153050 2024-04-17T15:10:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- 172.21.15.16:0/2211785901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 msgr2=0x7feabc159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 --2- 172.21.15.16:0/2211785901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc159780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feabc071970 tx=0x7feaac01ec70 comp rx=0 tx=0).stop 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- 172.21.15.16:0/2211785901 shutdown_connections 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 --2- 172.21.15.16:0/2211785901 >> v2:172.21.15.67:3300/0 conn(0x7feabc0c3970 0x7feabc0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 --2- 172.21.15.16:0/2211785901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc159780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- 172.21.15.16:0/2211785901 >> 172.21.15.16:0/2211785901 conn(0x7feabc06ba30 msgr2=0x7feabc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- 172.21.15.16:0/2211785901 shutdown_connections 2024-04-17T15:10:18.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- 172.21.15.16:0/2211785901 wait complete. 2024-04-17T15:10:18.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 Processor -- start 2024-04-17T15:10:18.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.207+0000 7feac1000640 1 -- start start 2024-04-17T15:10:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c3060 0x7feabc153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc0c3970 0x7feabc158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feabc06f440 con 0x7feabc153050 2024-04-17T15:10:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feabc06f160 con 0x7feabc0c3060 2024-04-17T15:10:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feac1000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7feabc06f720 con 0x7feabc0c3970 2024-04-17T15:10:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feaba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feaba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39900/0 (socket says 172.21.15.16:39900) 2024-04-17T15:10:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feaba800640 1 -- 172.21.15.16:0/2329420403 learned_addr learned my addr 172.21.15.16:0/2329420403 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:18.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feab3e00640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc0c3970 0x7feabc158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.211+0000 7feab9e00640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c3060 0x7feabc153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.215+0000 7feaba800640 1 -- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc0c3970 msgr2=0x7feabc158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.215+0000 7feaba800640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc0c3970 0x7feabc158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.215+0000 7feaba800640 1 -- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c3060 msgr2=0x7feabc153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.215+0000 7feaba800640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c3060 0x7feabc153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.215+0000 7feaba800640 1 -- 172.21.15.16:0/2329420403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc153b70 con 0x7feabc153050 2024-04-17T15:10:18.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.219+0000 7feaba800640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feab400efc0 tx=0x7feab400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4018020 con 0x7feabc153050 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab4014480 con 0x7feabc153050 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4014870 con 0x7feabc153050 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc156f90 con 0x7feabc153050 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc14e5a0 con 0x7feabc153050 2024-04-17T15:10:18.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.223+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feabc076280 con 0x7feabc153050 2024-04-17T15:10:18.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.243+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feab401b020 con 0x7feabc153050 2024-04-17T15:10:18.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.243+0000 7feab2000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 0x7fea9806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.243+0000 7feab9e00640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 0x7fea9806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.247+0000 7feab9e00640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 0x7fea9806a890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b2000 tx=0x7feaac0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.247+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7feab4055c90 con 0x7feabc153050 2024-04-17T15:10:18.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.511+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7feab4022030 con 0x7feabc153050 2024-04-17T15:10:18.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.679+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7feabc14d0e0 con 0x7fea980683d0 2024-04-17T15:10:18.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feab2000640 1 -- 172.21.15.16:0/2329420403 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feabc14d0e0 con 0x7fea980683d0 2024-04-17T15:10:18.682 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 msgr2=0x7fea9806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 0x7fea9806a890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b2000 tx=0x7feaac0aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 msgr2=0x7feabc141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feab400efc0 tx=0x7feab400c490 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 shutdown_connections 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fea980683d0 0x7fea9806a890 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feabc153050 0x7feabc141d00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feabc0c3970 0x7feabc158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 --2- 172.21.15.16:0/2329420403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feabc0c3060 0x7feabc153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 >> 172.21.15.16:0/2329420403 conn(0x7feabc06ba30 msgr2=0x7feabc14d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 shutdown_connections 2024-04-17T15:10:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.683+0000 7feac1000640 1 -- 172.21.15.16:0/2329420403 wait complete. 2024-04-17T15:10:18.703 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T15:10:18.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 Processor -- start 2024-04-17T15:10:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 -- start start 2024-04-17T15:10:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 0x7f64640c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f64640c38e0 0x7f64640c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64640c4270 con 0x7f6464159960 2024-04-17T15:10:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f64640c8b40 con 0x7f64640c38e0 2024-04-17T15:10:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.855+0000 7f646c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f64640c8e20 con 0x7f6464153330 2024-04-17T15:10:18.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.863+0000 7f6469200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6464159960 0x7f646406f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:45370/0 (socket says 172.21.15.16:45370) 2024-04-17T15:10:18.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.863+0000 7f6469200640 1 -- 172.21.15.16:0/1121386872 learned_addr learned my addr 172.21.15.16:0/1121386872 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.867+0000 7f646a600640 1 --2- 172.21.15.16:0/1121386872 >> v2:172.21.15.67:3300/0 conn(0x7f64640c38e0 0x7f64640c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.919+0000 7f6469c00640 1 --2- 172.21.15.16:0/1121386872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 0x7f64640c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.927+0000 7f6469c00640 1 -- 172.21.15.16:0/1121386872 >> v2:172.21.15.67:3300/0 conn(0x7f64640c38e0 msgr2=0x7f64640c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.927+0000 7f6469c00640 1 --2- 172.21.15.16:0/1121386872 >> v2:172.21.15.67:3300/0 conn(0x7f64640c38e0 0x7f64640c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.927+0000 7f6469c00640 1 -- 172.21.15.16:0/1121386872 >> v1:172.21.15.67:6789/0 conn(0x7f6464159960 legacy=0x7f646406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.927+0000 7f6469c00640 1 -- 172.21.15.16:0/1121386872 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64640c9100 con 0x7f6464153330 2024-04-17T15:10:18.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.935+0000 7f6469c00640 1 --2- 172.21.15.16:0/1121386872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 0x7f64640c7090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64580097c0 tx=0x7f645801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed7b4908bc22f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f6463e00640 1 -- 172.21.15.16:0/1121386872 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64580b5070 con 0x7f6464153330 2024-04-17T15:10:18.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f6463e00640 1 -- 172.21.15.16:0/1121386872 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64580a8990 con 0x7f6464153330 2024-04-17T15:10:18.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f6463e00640 1 -- 172.21.15.16:0/1121386872 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64580a8d60 con 0x7f6464153330 2024-04-17T15:10:18.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- 172.21.15.16:0/1121386872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 msgr2=0x7f64640c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 --2- 172.21.15.16:0/1121386872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 0x7f64640c7090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64580097c0 tx=0x7f645801ec90 comp rx=0 tx=0).stop 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- 172.21.15.16:0/1121386872 shutdown_connections 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 --2- 172.21.15.16:0/1121386872 >> v2:172.21.15.67:3300/0 conn(0x7f64640c38e0 0x7f64640c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 --2- 172.21.15.16:0/1121386872 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6464153330 0x7f64640c7090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- 172.21.15.16:0/1121386872 >> 172.21.15.16:0/1121386872 conn(0x7f646406ba30 msgr2=0x7f646406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- 172.21.15.16:0/1121386872 shutdown_connections 2024-04-17T15:10:18.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- 172.21.15.16:0/1121386872 wait complete. 2024-04-17T15:10:18.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 Processor -- start 2024-04-17T15:10:18.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.943+0000 7f646c600640 1 -- start start 2024-04-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64640c38e0 0x7f64641f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 0x7f6464144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6464159960 0x7f6464145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6464159dc0 con 0x7f6464153330 2024-04-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64640c96c0 con 0x7f6464159960 2024-04-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f646c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f646406fc50 con 0x7f64640c38e0 2024-04-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f6469200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 0x7f6464144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f6469200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 0x7f6464144f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39910/0 (socket says 172.21.15.16:39910) 2024-04-17T15:10:18.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f6469200640 1 -- 172.21.15.16:0/406322283 learned_addr learned my addr 172.21.15.16:0/406322283 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:18.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.947+0000 7f6469c00640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64640c38e0 0x7f64641f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 -- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64640c38e0 msgr2=0x7f64641f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f64640c38e0 0x7f64641f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 -- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6464159960 msgr2=0x7f6464145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6464159960 0x7f6464145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641f1720 con 0x7f6464153330 2024-04-17T15:10:18.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.951+0000 7f6469200640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 0x7f6464144f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f645000c370 tx=0x7f645000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450017070 con 0x7f6464153330 2024-04-17T15:10:18.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6450005cf0 con 0x7f6464153330 2024-04-17T15:10:18.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64500072f0 con 0x7f6464153330 2024-04-17T15:10:18.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6464150c20 con 0x7f6464153330 2024-04-17T15:10:18.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641f3ed0 con 0x7f6464153330 2024-04-17T15:10:18.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.955+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64641509d0 con 0x7f6464153330 2024-04-17T15:10:18.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.979+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f645001a070 con 0x7f6464153330 2024-04-17T15:10:18.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.979+0000 7f6461600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6444068400 0x7f644406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.979+0000 7f6469c00640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6444068400 0x7f644406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.979+0000 7f6469c00640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6444068400 0x7f644406a8c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64580b2000 tx=0x7f64580aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6450054330 con 0x7f6464153330 2024-04-17T15:10:18.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f6461600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7f6444070660 0x7f6444072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:18.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6444073150 con 0x7f6444070660 2024-04-17T15:10:18.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6450052530 con 0x7f6464153330 2024-04-17T15:10:18.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f646a600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7f6444070660 0x7f6444072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:18.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f646a600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7f6444070660 0x7f6444072a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:18.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.983+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== osd.6 v2:172.21.15.67:6826/3773130679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6444073150 con 0x7f6444070660 2024-04-17T15:10:18.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 --> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f64641f4490 con 0x7f6444070660 2024-04-17T15:10:18.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f6461600640 1 -- 172.21.15.16:0/406322283 <== osd.6 v2:172.21.15.67:6826/3773130679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f64641f4490 con 0x7f6444070660 2024-04-17T15:10:19.000 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:19.000 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:19.000 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7f6444070660 msgr2=0x7f6444072a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6826/3773130679,v1:172.21.15.67:6827/3773130679] conn(0x7f6444070660 0x7f6444072a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6444068400 msgr2=0x7f644406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6444068400 0x7f644406a8c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64580b2000 tx=0x7f64580aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 msgr2=0x7f6464144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 --2- 172.21.15.16:0/406322283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6464153330 0x7f6464144f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f645000c370 tx=0x7f645000c830 comp rx=0 tx=0).stop 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646a600640 1 -- 172.21.15.16:0/406322283 reap_dead start 2024-04-17T15:10:19.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 shutdown_connections 2024-04-17T15:10:19.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 >> 172.21.15.16:0/406322283 conn(0x7f646406ba30 msgr2=0x7f6464149040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:19.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 shutdown_connections 2024-04-17T15:10:19.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:18.999+0000 7f646c600640 1 -- 172.21.15.16:0/406322283 wait complete. 2024-04-17T15:10:19.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T15:10:19.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 Processor -- start 2024-04-17T15:10:19.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 -- start start 2024-04-17T15:10:19.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12bc15be40 0x7f12bc0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12bc0c5a20 0x7f12bc0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12bc158610 con 0x7f12bc151db0 2024-04-17T15:10:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f12bc0c8be0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c4400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f12bc071b30 con 0x7f12bc15be40 2024-04-17T15:10:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.159+0000 7f12c2400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12bc0c5a20 0x7f12bc0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12bc0c5a20 0x7f12bc0c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39926/0 (socket says 172.21.15.16:39926) 2024-04-17T15:10:19.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 -- 172.21.15.16:0/4236875497 learned_addr learned my addr 172.21.15.16:0/4236875497 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:19.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c1000640 1 --2- 172.21.15.16:0/4236875497 >> v2:172.21.15.67:3300/0 conn(0x7f12bc15be40 0x7f12bc0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 -- 172.21.15.16:0/4236875497 >> v2:172.21.15.67:3300/0 conn(0x7f12bc15be40 msgr2=0x7f12bc0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:19.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 --2- 172.21.15.16:0/4236875497 >> v2:172.21.15.67:3300/0 conn(0x7f12bc15be40 0x7f12bc0c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 -- 172.21.15.16:0/4236875497 >> v1:172.21.15.16:6789/0 conn(0x7f12bc151db0 legacy=0x7f12bc157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.163+0000 7f12c2400640 1 -- 172.21.15.16:0/4236875497 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc1588f0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.167+0000 7f12c2400640 1 --2- 172.21.15.16:0/4236875497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc0c3970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0716d0 tx=0x7f12b40213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2ac3e0c49c2708 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.171+0000 7f12bbe00640 1 -- 172.21.15.16:0/4236875497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40b6070 con 0x7f12bc0c5a20 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.171+0000 7f12bbe00640 1 -- 172.21.15.16:0/4236875497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b400b2d0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.171+0000 7f12bbe00640 1 -- 172.21.15.16:0/4236875497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b400b480 con 0x7f12bc0c5a20 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.171+0000 7f12c4400640 1 -- 172.21.15.16:0/4236875497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 msgr2=0x7f12bc0c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.171+0000 7f12c4400640 1 --2- 172.21.15.16:0/4236875497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc0c3970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0716d0 tx=0x7f12b40213e0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- 172.21.15.16:0/4236875497 shutdown_connections 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 --2- 172.21.15.16:0/4236875497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc0c3970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 --2- 172.21.15.16:0/4236875497 >> v2:172.21.15.67:3300/0 conn(0x7f12bc15be40 0x7f12bc0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- 172.21.15.16:0/4236875497 >> 172.21.15.16:0/4236875497 conn(0x7f12bc06ba30 msgr2=0x7f12bc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:19.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- 172.21.15.16:0/4236875497 shutdown_connections 2024-04-17T15:10:19.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- 172.21.15.16:0/4236875497 wait complete. 2024-04-17T15:10:19.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 Processor -- start 2024-04-17T15:10:19.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- start start 2024-04-17T15:10:19.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12bc151db0 0x7f12bc1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12bc15be40 0x7f12bc0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc15b920 con 0x7f12bc0c5a20 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc15b640 con 0x7f12bc151db0 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f12bc1582e0 con 0x7f12bc15be40 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.175+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39934/0 (socket says 172.21.15.16:39934) 2024-04-17T15:10:19.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 -- 172.21.15.16:0/3649150238 learned_addr learned my addr 172.21.15.16:0/3649150238 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:19.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1000640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12bc151db0 0x7f12bc1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c2400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12bc15be40 0x7f12bc0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 -- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12bc15be40 msgr2=0x7f12bc0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12bc15be40 0x7f12bc0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 -- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12bc151db0 msgr2=0x7f12bc1535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12bc151db0 0x7f12bc1535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.179+0000 7f12c1a00640 1 -- 172.21.15.16:0/3649150238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc15a840 con 0x7f12bc0c5a20 2024-04-17T15:10:19.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.183+0000 7f12c1a00640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c450 tx=0x7f12b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0016020 con 0x7f12bc0c5a20 2024-04-17T15:10:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b00052d0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0007260 con 0x7f12bc0c5a20 2024-04-17T15:10:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc1f46c0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc159d70 con 0x7f12bc0c5a20 2024-04-17T15:10:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.199+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc076280 con 0x7f12bc0c5a20 2024-04-17T15:10:19.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.471+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12b0007400 con 0x7f12bc0c5a20 2024-04-17T15:10:19.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.471+0000 7f12b9600640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 0x7f129c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.471+0000 7f12c1000640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 0x7f129c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.471+0000 7f12c1000640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 0x7f129c06a890 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0c59f0 tx=0x7f12a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.487+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f12b00550e0 con 0x7f12bc0c5a20 2024-04-17T15:10:19.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.491+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f12b0020020 con 0x7f12bc0c5a20 2024-04-17T15:10:19.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.663+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f12bc06c190 con 0x7f129c0683d0 2024-04-17T15:10:19.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.663+0000 7f12b9600640 1 -- 172.21.15.16:0/3649150238 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12bc06c190 con 0x7f129c0683d0 2024-04-17T15:10:19.664 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 msgr2=0x7f129c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 0x7f129c06a890 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0c59f0 tx=0x7f12a8008040 comp rx=0 tx=0).stop 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 msgr2=0x7f12bc1f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c450 tx=0x7f12b000c910 comp rx=0 tx=0).stop 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 shutdown_connections 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f129c0683d0 0x7f129c06a890 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f12bc15be40 0x7f12bc0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12bc151db0 0x7f12bc1535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 --2- 172.21.15.16:0/3649150238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12bc0c5a20 0x7f12bc1f5130 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 >> 172.21.15.16:0/3649150238 conn(0x7f12bc06ba30 msgr2=0x7f12bc072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:19.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 shutdown_connections 2024-04-17T15:10:19.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.667+0000 7f12c4400640 1 -- 172.21.15.16:0/3649150238 wait complete. 2024-04-17T15:10:19.686 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T15:10:19.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:10:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.835+0000 7f633e400640 1 Processor -- start 2024-04-17T15:10:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 -- start start 2024-04-17T15:10:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6338158440 0x7f633815b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63380ca880 0x7f633815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63380c9320 con 0x7f63380b0c00 2024-04-17T15:10:19.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6338158820 con 0x7f6338158440 2024-04-17T15:10:19.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633e400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f63380c9600 con 0x7f63380ca880 2024-04-17T15:10:19.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6338158440 0x7f633815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6338158440 0x7f633815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39936/0 (socket says 172.21.15.16:39936) 2024-04-17T15:10:19.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.839+0000 7f633d000640 1 -- 172.21.15.16:0/3101535288 learned_addr learned my addr 172.21.15.16:0/3101535288 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.843+0000 7f6337e00640 1 --2- 172.21.15.16:0/3101535288 >> v2:172.21.15.67:3300/0 conn(0x7f63380ca880 0x7f633815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.843+0000 7f633d000640 1 -- 172.21.15.16:0/3101535288 >> v2:172.21.15.67:3300/0 conn(0x7f63380ca880 msgr2=0x7f633815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.843+0000 7f633d000640 1 --2- 172.21.15.16:0/3101535288 >> v2:172.21.15.67:3300/0 conn(0x7f63380ca880 0x7f633815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.843+0000 7f633d000640 1 -- 172.21.15.16:0/3101535288 >> v1:172.21.15.16:6789/0 conn(0x7f63380b0c00 legacy=0x7f63380caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.843+0000 7f633d000640 1 -- 172.21.15.16:0/3101535288 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63380c98e0 con 0x7f6338158440 2024-04-17T15:10:19.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.847+0000 7f633d000640 1 --2- 172.21.15.16:0/3101535288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f633815b930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6338072280 tx=0x7f632c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fe654a015fd227 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f6337400640 1 -- 172.21.15.16:0/3101535288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0b5070 con 0x7f6338158440 2024-04-17T15:10:19.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f6337400640 1 -- 172.21.15.16:0/3101535288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c0a8a10 con 0x7f6338158440 2024-04-17T15:10:19.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f6337400640 1 -- 172.21.15.16:0/3101535288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0a8de0 con 0x7f6338158440 2024-04-17T15:10:19.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- 172.21.15.16:0/3101535288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 msgr2=0x7f633815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 --2- 172.21.15.16:0/3101535288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f633815b930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6338072280 tx=0x7f632c01ed10 comp rx=0 tx=0).stop 2024-04-17T15:10:19.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- 172.21.15.16:0/3101535288 shutdown_connections 2024-04-17T15:10:19.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 --2- 172.21.15.16:0/3101535288 >> v2:172.21.15.67:3300/0 conn(0x7f63380ca880 0x7f633815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 --2- 172.21.15.16:0/3101535288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f633815b930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- 172.21.15.16:0/3101535288 >> 172.21.15.16:0/3101535288 conn(0x7f6338062cd0 msgr2=0x7f6338071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:19.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- 172.21.15.16:0/3101535288 shutdown_connections 2024-04-17T15:10:19.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- 172.21.15.16:0/3101535288 wait complete. 2024-04-17T15:10:19.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 Processor -- start 2024-04-17T15:10:19.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.859+0000 7f633e400640 1 -- start start 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63380b0c00 0x7f63381f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63380ca880 0x7f63381e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f63380afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f633815b410 con 0x7f6338158440 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f633815b130 con 0x7f63380b0c00 2024-04-17T15:10:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.863+0000 7f633e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f63380b1090 con 0x7f63380ca880 2024-04-17T15:10:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.879+0000 7f633da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f63380afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.879+0000 7f633da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f63380afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39952/0 (socket says 172.21.15.16:39952) 2024-04-17T15:10:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.879+0000 7f633da00640 1 -- 172.21.15.16:0/642672964 learned_addr learned my addr 172.21.15.16:0/642672964 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.883+0000 7f633da00640 1 -- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63380ca880 msgr2=0x7f63381e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.883+0000 7f633da00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f63380ca880 0x7f63381e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.883+0000 7f633da00640 1 -- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63380b0c00 msgr2=0x7f63381f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.883+0000 7f633da00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63380b0c00 0x7f63381f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.883+0000 7f633da00640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63381e7ed0 con 0x7f6338158440 2024-04-17T15:10:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.935+0000 7f633da00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f63380afc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f633000c7a0 tx=0x7f633000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330003b80 con 0x7f6338158440 2024-04-17T15:10:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6330003d20 con 0x7f6338158440 2024-04-17T15:10:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633000aa90 con 0x7f6338158440 2024-04-17T15:10:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63380b0730 con 0x7f6338158440 2024-04-17T15:10:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381e7910 con 0x7f6338158440 2024-04-17T15:10:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.947+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63380761a0 con 0x7f6338158440 2024-04-17T15:10:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f633000ac30 con 0x7f6338158440 2024-04-17T15:10:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6318068400 0x7f631806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f633d000640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6318068400 0x7f631806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f633d000640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6318068400 0x7f631806a8c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f632c0b2000 tx=0x7f632c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6330055260 con 0x7f6338158440 2024-04-17T15:10:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7f6318070660 0x7f6318072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6330015ec0 con 0x7f6318070660 2024-04-17T15:10:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6330053460 con 0x7f6338158440 2024-04-17T15:10:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.971+0000 7f6337e00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7f6318070660 0x7f6318072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.975+0000 7f6337e00640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7f6318070660 0x7f6318072a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.975+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== osd.7 v2:172.21.15.67:6802/1496189584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6330015ec0 con 0x7f6318070660 2024-04-17T15:10:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.987+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 --> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f633815ac30 con 0x7f6318070660 2024-04-17T15:10:19.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f6334c00640 1 -- 172.21.15.16:0/642672964 <== osd.7 v2:172.21.15.67:6802/1496189584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f633815ac30 con 0x7f6318070660 2024-04-17T15:10:19.990 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-17T15:10:19.990 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:10:19.990 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7f6318070660 msgr2=0x7f6318072a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6802/1496189584,v1:172.21.15.67:6803/1496189584] conn(0x7f6318070660 0x7f6318072a80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6318068400 msgr2=0x7f631806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6318068400 0x7f631806a8c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f632c0b2000 tx=0x7f632c004740 comp rx=0 tx=0).stop 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 msgr2=0x7f63380afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 --2- 172.21.15.16:0/642672964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6338158440 0x7f63380afc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f633000c7a0 tx=0x7f633000cc60 comp rx=0 tx=0).stop 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633da00640 1 -- 172.21.15.16:0/642672964 reap_dead start 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 shutdown_connections 2024-04-17T15:10:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 >> 172.21.15.16:0/642672964 conn(0x7f6338062cd0 msgr2=0x7f6338155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 shutdown_connections 2024-04-17T15:10:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:19.991+0000 7f633e400640 1 -- 172.21.15.16:0/642672964 wait complete. 2024-04-17T15:10:20.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T15:10:20.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 Processor -- start 2024-04-17T15:10:20.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 -- start start 2024-04-17T15:10:20.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f686c151db0 0x7f686c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c158610 con 0x7f686c0c5a20 2024-04-17T15:10:20.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c1588f0 con 0x7f686c15be40 2024-04-17T15:10:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6873c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f686c0c8be0 con 0x7f686c151db0 2024-04-17T15:10:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6871200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f686c151db0 0x7f686c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6871c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f686c0c5a20 0x7f686c0c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53948/0 (socket says 172.21.15.16:53948) 2024-04-17T15:10:20.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.155+0000 7f6871c00640 1 -- 172.21.15.16:0/573425690 learned_addr learned my addr 172.21.15.16:0/573425690 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:20.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.159+0000 7f6871200640 1 -- 172.21.15.16:0/573425690 >> v1:172.21.15.67:6789/0 conn(0x7f686c15be40 legacy=0x7f686c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:20.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.159+0000 7f6871200640 1 -- 172.21.15.16:0/573425690 >> v1:172.21.15.16:6789/0 conn(0x7f686c0c5a20 legacy=0x7f686c0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.159+0000 7f6871200640 1 -- 172.21.15.16:0/573425690 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c15b360 con 0x7f686c151db0 2024-04-17T15:10:20.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.167+0000 7f6871200640 1 --2- 172.21.15.16:0/573425690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c151db0 0x7f686c0c86a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f685c0097c0 tx=0x7f685c020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a263df340c1efc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:20.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f686be00640 1 -- 172.21.15.16:0/573425690 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b7070 con 0x7f686c151db0 2024-04-17T15:10:20.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f686be00640 1 -- 172.21.15.16:0/573425690 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0aab60 con 0x7f686c151db0 2024-04-17T15:10:20.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f686be00640 1 -- 172.21.15.16:0/573425690 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b2440 con 0x7f686c151db0 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- 172.21.15.16:0/573425690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c151db0 msgr2=0x7f686c0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 --2- 172.21.15.16:0/573425690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c151db0 0x7f686c0c86a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f685c0097c0 tx=0x7f685c020e60 comp rx=0 tx=0).stop 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- 172.21.15.16:0/573425690 shutdown_connections 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 --2- 172.21.15.16:0/573425690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c151db0 0x7f686c0c86a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- 172.21.15.16:0/573425690 >> 172.21.15.16:0/573425690 conn(0x7f686c06ba30 msgr2=0x7f686c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- 172.21.15.16:0/573425690 shutdown_connections 2024-04-17T15:10:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- 172.21.15.16:0/573425690 wait complete. 2024-04-17T15:10:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 Processor -- start 2024-04-17T15:10:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- start start 2024-04-17T15:10:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c0c5a20 0x7f686c1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686c151db0 0x7f686c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15b920 con 0x7f686c15be40 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f686c071b30 con 0x7f686c0c5a20 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.171+0000 7f6873c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f686c1582e0 con 0x7f686c151db0 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.175+0000 7f6871c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.175+0000 7f6871c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39980/0 (socket says 172.21.15.16:39980) 2024-04-17T15:10:20.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.175+0000 7f6871c00640 1 -- 172.21.15.16:0/2009401951 learned_addr learned my addr 172.21.15.16:0/2009401951 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:20.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 -- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686c151db0 msgr2=0x7f686c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686c151db0 0x7f686c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 -- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c0c5a20 msgr2=0x7f686c1f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c0c5a20 0x7f686c1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 -- 172.21.15.16:0/2009401951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c1f0ed0 con 0x7f686c15be40 2024-04-17T15:10:20.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.179+0000 7f6871c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f686400ca80 tx=0x7f686400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:20.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864017070 con 0x7f686c15be40 2024-04-17T15:10:20.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686400ac30 con 0x7f686c15be40 2024-04-17T15:10:20.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864012400 con 0x7f686c15be40 2024-04-17T15:10:20.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c155c30 con 0x7f686c15be40 2024-04-17T15:10:20.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c1561d0 con 0x7f686c15be40 2024-04-17T15:10:20.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.183+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c1f0cc0 con 0x7f686c15be40 2024-04-17T15:10:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.207+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f686401a070 con 0x7f686c15be40 2024-04-17T15:10:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.207+0000 7f6869600640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 0x7f684806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.207+0000 7f6871200640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 0x7f684806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.207+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6864054aa0 con 0x7f686c15be40 2024-04-17T15:10:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.207+0000 7f6871200640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 0x7f684806a8c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b4000 tx=0x7f685c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:20.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.463+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6864056a00 con 0x7f686c15be40 2024-04-17T15:10:20.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.631+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f686c0ca970 con 0x7f6848068400 2024-04-17T15:10:20.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.631+0000 7f6869600640 1 -- 172.21.15.16:0/2009401951 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f686c0ca970 con 0x7f6848068400 2024-04-17T15:10:20.633 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T15:10:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 msgr2=0x7f684806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 0x7f684806a8c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b4000 tx=0x7f685c004740 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 msgr2=0x7f686c0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f686400ca80 tx=0x7f686400cf40 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 shutdown_connections 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f6848068400 0x7f684806a8c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f686c15be40 0x7f686c0cca00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f686c151db0 0x7f686c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 --2- 172.21.15.16:0/2009401951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c0c5a20 0x7f686c1f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 >> 172.21.15.16:0/2009401951 conn(0x7f686c06ba30 msgr2=0x7f686c14dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 shutdown_connections 2024-04-17T15:10:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.635+0000 7f6873c00640 1 -- 172.21.15.16:0/2009401951 wait complete. 2024-04-17T15:10:20.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:10:20.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 Processor -- start 2024-04-17T15:10:20.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 -- start start 2024-04-17T15:10:20.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1a900c9a70 0x7f1a900c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a900b14b0 0x7f1a9015b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9015aed0 con 0x7f1a900c9690 2024-04-17T15:10:20.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9015ebb0 con 0x7f1a900b14b0 2024-04-17T15:10:20.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.799+0000 7f1a96200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9015ee90 con 0x7f1a900c9a70 2024-04-17T15:10:20.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a900b14b0 0x7f1a9015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a900b14b0 0x7f1a9015b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39994/0 (socket says 172.21.15.16:39994) 2024-04-17T15:10:20.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 -- 172.21.15.16:0/2718476417 learned_addr learned my addr 172.21.15.16:0/2718476417 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:20.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 -- 172.21.15.16:0/2718476417 >> v2:172.21.15.67:3300/0 conn(0x7f1a900c9a70 msgr2=0x7f1a900c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:20.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 --2- 172.21.15.16:0/2718476417 >> v2:172.21.15.67:3300/0 conn(0x7f1a900c9a70 0x7f1a900c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 -- 172.21.15.16:0/2718476417 >> v1:172.21.15.67:6789/0 conn(0x7f1a900c9690 legacy=0x7f1a900b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:20.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.803+0000 7f1a8fe00640 1 -- 172.21.15.16:0/2718476417 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9015f170 con 0x7f1a900b14b0 2024-04-17T15:10:20.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.807+0000 7f1a8fe00640 1 --2- 172.21.15.16:0/2718476417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900b14b0 0x7f1a9015b990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b1ac0 tx=0x7f1a8801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385615fe56245427 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:20.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a8ea00640 1 -- 172.21.15.16:0/2718476417 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a57b0 con 0x7f1a900b14b0 2024-04-17T15:10:20.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a8ea00640 1 -- 172.21.15.16:0/2718476417 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a5950 con 0x7f1a900b14b0 2024-04-17T15:10:20.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a8ea00640 1 -- 172.21.15.16:0/2718476417 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a5d20 con 0x7f1a900b14b0 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 -- 172.21.15.16:0/2718476417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900b14b0 msgr2=0x7f1a9015b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 --2- 172.21.15.16:0/2718476417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900b14b0 0x7f1a9015b990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b1ac0 tx=0x7f1a8801c8f0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 -- 172.21.15.16:0/2718476417 shutdown_connections 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 --2- 172.21.15.16:0/2718476417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900b14b0 0x7f1a9015b990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 --2- 172.21.15.16:0/2718476417 >> v2:172.21.15.67:3300/0 conn(0x7f1a900c9a70 0x7f1a900c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 -- 172.21.15.16:0/2718476417 >> 172.21.15.16:0/2718476417 conn(0x7f1a90062850 msgr2=0x7f1a9006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 -- 172.21.15.16:0/2718476417 shutdown_connections 2024-04-17T15:10:20.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.811+0000 7f1a96200640 1 -- 172.21.15.16:0/2718476417 wait complete. 2024-04-17T15:10:20.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 Processor -- start 2024-04-17T15:10:20.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 -- start start 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a900b14b0 0x7f1a901f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900c9a70 0x7f1a9014c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900c3670 con 0x7f1a900c9690 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015e850 con 0x7f1a900c9a70 2024-04-17T15:10:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a96200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900c37f0 con 0x7f1a900b14b0 2024-04-17T15:10:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a86a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a86a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40002/0 (socket says 172.21.15.16:40002) 2024-04-17T15:10:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a86a00640 1 -- 172.21.15.16:0/3034936785 learned_addr learned my addr 172.21.15.16:0/3034936785 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.815+0000 7f1a8f400640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a900b14b0 0x7f1a901f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a8fe00640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900c9a70 0x7f1a9014c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a86a00640 1 -- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a900b14b0 msgr2=0x7f1a901f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a86a00640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a900b14b0 0x7f1a901f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a86a00640 1 -- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900c9a70 msgr2=0x7f1a9014c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a86a00640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900c9a70 0x7f1a9014c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.819+0000 7f1a86a00640 1 -- 172.21.15.16:0/3034936785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a901f4c60 con 0x7f1a900c9690 2024-04-17T15:10:20.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.823+0000 7f1a86a00640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800b440 tx=0x7f1a7800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:20.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78015020 con 0x7f1a900c9690 2024-04-17T15:10:20.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a780118b0 con 0x7f1a900c9690 2024-04-17T15:10:20.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78011ca0 con 0x7f1a900c9690 2024-04-17T15:10:20.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a90151f40 con 0x7f1a900c9690 2024-04-17T15:10:20.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a90152500 con 0x7f1a900c9690 2024-04-17T15:10:20.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.827+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a90076280 con 0x7f1a900c9690 2024-04-17T15:10:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.847+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a78018020 con 0x7f1a900c9690 2024-04-17T15:10:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.847+0000 7f1a87e00640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 0x7f1a6c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.851+0000 7f1a8f400640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 0x7f1a6c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:20.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:20.851+0000 7f1a8f400640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 0x7f1a6c06a890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:21.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.111+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1a78054f10 con 0x7f1a900c9690 2024-04-17T15:10:21.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.111+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1a7801f020 con 0x7f1a900c9690 2024-04-17T15:10:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.275+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a900c9fe0 con 0x7f1a6c0683d0 2024-04-17T15:10:21.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.283+0000 7f1a87e00640 1 -- 172.21.15.16:0/3034936785 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251148 (secure 0 0 0) 0x7f1a900c9fe0 con 0x7f1a6c0683d0 2024-04-17T15:10:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:21.288 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 msgr2=0x7f1a6c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 0x7f1a6c06a890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80009040 comp rx=0 tx=0).stop 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 msgr2=0x7f1a900ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800b440 tx=0x7f1a7800b900 comp rx=0 tx=0).stop 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 shutdown_connections 2024-04-17T15:10:21.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f1a6c0683d0 0x7f1a6c06a890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900c9a70 0x7f1a9014c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a900c9690 0x7f1a900ccaa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 --2- 172.21.15.16:0/3034936785 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a900b14b0 0x7f1a901f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 >> 172.21.15.16:0/3034936785 conn(0x7f1a90062850 msgr2=0x7f1a90158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 shutdown_connections 2024-04-17T15:10:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:21.287+0000 7f1a96200640 1 -- 172.21.15.16:0/3034936785 wait complete. 2024-04-17T15:10:21.309 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":951,"stamp":"2024-04-17T15:10:19.719582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39279334,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1260,"num_read_kb":137987,"num_write":14354,"num_write_kb":371168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14000,"ondisk_log_size":14000,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349008,"kb_used_data":78800,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754625712,"statfs":{"total":773094113280,"available":772736729088,"internally_reserved":0,"allocated":80691200,"data_stored":79314348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14536,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004666"},"pg_stats":[{"pgid":"3.3f","version":"25'63","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.132652+0000","last_change":"2024-04-17T14:39:59.449839+0000","last_active":"2024-04-17T15:10:09.132652+0000","last_peered":"2024-04-17T15:10:09.132652+0000","last_clean":"2024-04-17T15:10:09.132652+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T15:10:09.132652+0000","last_undegraded":"2024-04-17T15:10:09.132652+0000","last_fullsized":"2024-04-17T15:10:09.132652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":45,"num_write_kb":3409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'73","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.110349+0000","last_change":"2024-04-17T14:39:59.426148+0000","last_active":"2024-04-17T15:10:09.110349+0000","last_peered":"2024-04-17T15:10:09.110349+0000","last_clean":"2024-04-17T15:10:09.110349+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T15:10:09.110349+0000","last_undegraded":"2024-04-17T15:10:09.110349+0000","last_fullsized":"2024-04-17T15:10:09.110349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:20.141937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":60,"num_write_kb":3465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'84","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.107780+0000","last_change":"2024-04-17T14:39:59.282554+0000","last_active":"2024-04-17T15:10:09.107780+0000","last_peered":"2024-04-17T15:10:09.107780+0000","last_clean":"2024-04-17T15:10:09.107780+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T15:10:09.107780+0000","last_undegraded":"2024-04-17T15:10:09.107780+0000","last_fullsized":"2024-04-17T15:10:09.107780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:19:22.976103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":2861,"num_write":63,"num_write_kb":6749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'56","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.817921+0000","last_change":"2024-04-17T15:10:17.817942+0000","last_active":"2024-04-17T15:10:17.817921+0000","last_peered":"2024-04-17T15:10:17.817921+0000","last_clean":"2024-04-17T15:10:17.817921+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T15:10:17.817921+0000","last_undegraded":"2024-04-17T15:10:17.817921+0000","last_fullsized":"2024-04-17T15:10:17.817921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-04-17T15:10:17.817843+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-04-17T15:10:17.817843+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.817843+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:22:21.592689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'98","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.149528+0000","last_change":"2024-04-17T14:39:59.447966+0000","last_active":"2024-04-17T15:10:09.149528+0000","last_peered":"2024-04-17T15:10:09.149528+0000","last_clean":"2024-04-17T15:10:09.149528+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T15:10:09.149528+0000","last_undegraded":"2024-04-17T15:10:09.149528+0000","last_fullsized":"2024-04-17T15:10:09.149528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2548,"num_write":80,"num_write_kb":4150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'98","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.953622+0000","last_change":"2024-04-17T14:39:59.405406+0000","last_active":"2024-04-17T15:10:08.953622+0000","last_peered":"2024-04-17T15:10:08.953622+0000","last_clean":"2024-04-17T15:10:08.953622+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T15:10:08.953622+0000","last_undegraded":"2024-04-17T15:10:08.953622+0000","last_fullsized":"2024-04-17T15:10:08.953622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":80,"num_write_kb":2528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'101","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.147783+0000","last_change":"2024-04-17T14:39:59.447050+0000","last_active":"2024-04-17T15:10:09.147783+0000","last_peered":"2024-04-17T15:10:09.147783+0000","last_clean":"2024-04-17T15:10:09.147783+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T15:10:09.147783+0000","last_undegraded":"2024-04-17T15:10:09.147783+0000","last_fullsized":"2024-04-17T15:10:09.147783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":86,"num_write_kb":7600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'79","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.120731+0000","last_change":"2024-04-17T14:39:59.447891+0000","last_active":"2024-04-17T15:10:09.120731+0000","last_peered":"2024-04-17T15:10:09.120731+0000","last_clean":"2024-04-17T15:10:09.120731+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T15:10:09.120731+0000","last_undegraded":"2024-04-17T15:10:09.120731+0000","last_fullsized":"2024-04-17T15:10:09.120731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:16.975802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1525,"num_write":67,"num_write_kb":3989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'88","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.355893+0000","last_change":"2024-04-17T14:39:59.415499+0000","last_active":"2024-04-17T15:10:09.355893+0000","last_peered":"2024-04-17T15:10:09.355893+0000","last_clean":"2024-04-17T15:10:09.355893+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T15:10:09.355893+0000","last_undegraded":"2024-04-17T15:10:09.355893+0000","last_fullsized":"2024-04-17T15:10:09.355893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":58,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'91","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.150592+0000","last_change":"2024-04-17T14:39:59.450182+0000","last_active":"2024-04-17T15:10:09.150592+0000","last_peered":"2024-04-17T15:10:09.150592+0000","last_clean":"2024-04-17T15:10:09.150592+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T15:10:09.150592+0000","last_undegraded":"2024-04-17T15:10:09.150592+0000","last_fullsized":"2024-04-17T15:10:09.150592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":61,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'90","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.141667+0000","last_change":"2024-04-17T14:39:59.451210+0000","last_active":"2024-04-17T15:10:09.141667+0000","last_peered":"2024-04-17T15:10:09.141667+0000","last_clean":"2024-04-17T15:10:09.141667+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T15:10:09.141667+0000","last_undegraded":"2024-04-17T15:10:09.141667+0000","last_fullsized":"2024-04-17T15:10:09.141667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":68,"num_write_kb":6389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'61","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.146137+0000","last_change":"2024-04-17T14:39:59.451357+0000","last_active":"2024-04-17T15:10:09.146137+0000","last_peered":"2024-04-17T15:10:09.146137+0000","last_clean":"2024-04-17T15:10:09.146137+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T15:10:09.146137+0000","last_undegraded":"2024-04-17T15:10:09.146137+0000","last_fullsized":"2024-04-17T15:10:09.146137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":46,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'64","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.886315+0000","last_change":"2024-04-17T14:39:59.450062+0000","last_active":"2024-04-17T15:10:08.886315+0000","last_peered":"2024-04-17T15:10:08.886315+0000","last_clean":"2024-04-17T15:10:08.886315+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T15:10:08.886315+0000","last_undegraded":"2024-04-17T15:10:08.886315+0000","last_fullsized":"2024-04-17T15:10:08.886315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:34:14.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.886478+0000","last_change":"2024-04-17T14:39:59.426075+0000","last_active":"2024-04-17T15:10:08.886478+0000","last_peered":"2024-04-17T15:10:08.886478+0000","last_clean":"2024-04-17T15:10:08.886478+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T15:10:08.886478+0000","last_undegraded":"2024-04-17T15:10:08.886478+0000","last_fullsized":"2024-04-17T15:10:08.886478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:03:25.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":67,"num_write_kb":3643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'88","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.113873+0000","last_change":"2024-04-17T14:39:59.448354+0000","last_active":"2024-04-17T15:10:09.113873+0000","last_peered":"2024-04-17T15:10:09.113873+0000","last_clean":"2024-04-17T15:10:09.113873+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T15:10:09.113873+0000","last_undegraded":"2024-04-17T15:10:09.113873+0000","last_fullsized":"2024-04-17T15:10:09.113873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:04:02.014631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6351,"num_write":71,"num_write_kb":4827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'97","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.935631+0000","last_change":"2024-04-17T14:39:59.416398+0000","last_active":"2024-04-17T15:10:08.935631+0000","last_peered":"2024-04-17T15:10:08.935631+0000","last_clean":"2024-04-17T15:10:08.935631+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T15:10:08.935631+0000","last_undegraded":"2024-04-17T15:10:08.935631+0000","last_fullsized":"2024-04-17T15:10:08.935631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2606,"num_write":80,"num_write_kb":5984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'85","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.907818+0000","last_change":"2024-04-17T14:39:59.446450+0000","last_active":"2024-04-17T15:10:08.907818+0000","last_peered":"2024-04-17T15:10:08.907818+0000","last_clean":"2024-04-17T15:10:08.907818+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T15:10:08.907818+0000","last_undegraded":"2024-04-17T15:10:08.907818+0000","last_fullsized":"2024-04-17T15:10:08.907818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":64,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'92","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.843132+0000","last_change":"2024-04-17T14:39:59.405237+0000","last_active":"2024-04-17T15:10:08.843132+0000","last_peered":"2024-04-17T15:10:08.843132+0000","last_clean":"2024-04-17T15:10:08.843132+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T15:10:08.843132+0000","last_undegraded":"2024-04-17T15:10:08.843132+0000","last_fullsized":"2024-04-17T15:10:08.843132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:26:31.342586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":64,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'74","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.924670+0000","last_change":"2024-04-17T14:39:59.418173+0000","last_active":"2024-04-17T15:10:08.924670+0000","last_peered":"2024-04-17T15:10:08.924670+0000","last_clean":"2024-04-17T15:10:08.924670+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T15:10:08.924670+0000","last_undegraded":"2024-04-17T15:10:08.924670+0000","last_fullsized":"2024-04-17T15:10:08.924670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":51,"num_write_kb":3336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'113","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.146932+0000","last_change":"2024-04-17T14:39:59.451654+0000","last_active":"2024-04-17T15:10:09.146932+0000","last_peered":"2024-04-17T15:10:09.146932+0000","last_clean":"2024-04-17T15:10:09.146932+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T15:10:09.146932+0000","last_undegraded":"2024-04-17T15:10:09.146932+0000","last_fullsized":"2024-04-17T15:10:09.146932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":94,"num_write_kb":5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'107","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.154907+0000","last_change":"2024-04-17T14:39:59.406805+0000","last_active":"2024-04-17T15:10:09.154907+0000","last_peered":"2024-04-17T15:10:09.154907+0000","last_clean":"2024-04-17T15:10:09.154907+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T15:10:09.154907+0000","last_undegraded":"2024-04-17T15:10:09.154907+0000","last_fullsized":"2024-04-17T15:10:09.154907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":82,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'83","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.356976+0000","last_change":"2024-04-17T14:39:59.449138+0000","last_active":"2024-04-17T15:10:09.356976+0000","last_peered":"2024-04-17T15:10:09.356976+0000","last_clean":"2024-04-17T15:10:09.356976+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T15:10:09.356976+0000","last_undegraded":"2024-04-17T15:10:09.356976+0000","last_fullsized":"2024-04-17T15:10:09.356976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":63,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'80","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.115821+0000","last_change":"2024-04-17T14:39:59.404683+0000","last_active":"2024-04-17T15:10:09.115821+0000","last_peered":"2024-04-17T15:10:09.115821+0000","last_clean":"2024-04-17T15:10:09.115821+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T15:10:09.115821+0000","last_undegraded":"2024-04-17T15:10:09.115821+0000","last_fullsized":"2024-04-17T15:10:09.115821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:52.115547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":54,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'61","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.922543+0000","last_change":"2024-04-17T14:39:59.422534+0000","last_active":"2024-04-17T15:10:08.922543+0000","last_peered":"2024-04-17T15:10:08.922543+0000","last_clean":"2024-04-17T15:10:08.922543+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T15:10:08.922543+0000","last_undegraded":"2024-04-17T15:10:08.922543+0000","last_fullsized":"2024-04-17T15:10:08.922543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":45,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'90","reported_seq":135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.114334+0000","last_change":"2024-04-17T14:39:59.406637+0000","last_active":"2024-04-17T15:10:09.114334+0000","last_peered":"2024-04-17T15:10:09.114334+0000","last_clean":"2024-04-17T15:10:09.114334+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T15:10:09.114334+0000","last_undegraded":"2024-04-17T15:10:09.114334+0000","last_fullsized":"2024-04-17T15:10:09.114334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:46:18.241691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":81,"num_write_kb":3963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'93","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:15.963404+0000","last_change":"2024-04-17T14:39:59.417383+0000","last_active":"2024-04-17T15:10:15.963404+0000","last_peered":"2024-04-17T15:10:15.963404+0000","last_clean":"2024-04-17T15:10:15.963404+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T15:10:15.963404+0000","last_undegraded":"2024-04-17T15:10:15.963404+0000","last_fullsized":"2024-04-17T15:10:15.963404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":63,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'125","reported_seq":160,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.883983+0000","last_change":"2024-04-17T14:39:59.428745+0000","last_active":"2024-04-17T15:10:08.883983+0000","last_peered":"2024-04-17T15:10:08.883983+0000","last_clean":"2024-04-17T15:10:08.883983+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T15:10:08.883983+0000","last_undegraded":"2024-04-17T15:10:08.883983+0000","last_fullsized":"2024-04-17T15:10:08.883983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:02.532583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":109,"num_write_kb":10749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'59","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.888179+0000","last_change":"2024-04-17T14:39:59.448450+0000","last_active":"2024-04-17T15:10:08.888179+0000","last_peered":"2024-04-17T15:10:08.888179+0000","last_clean":"2024-04-17T15:10:08.888179+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T15:10:08.888179+0000","last_undegraded":"2024-04-17T15:10:08.888179+0000","last_fullsized":"2024-04-17T15:10:08.888179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:14.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2802,"num_write":38,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'73","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.108478+0000","last_change":"2024-04-17T14:39:59.278647+0000","last_active":"2024-04-17T15:10:09.108478+0000","last_peered":"2024-04-17T15:10:09.108478+0000","last_clean":"2024-04-17T15:10:09.108478+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T15:10:09.108478+0000","last_undegraded":"2024-04-17T15:10:09.108478+0000","last_fullsized":"2024-04-17T15:10:09.108478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:14.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":55,"num_write_kb":3974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'153","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.925505+0000","last_change":"2024-04-17T14:39:59.421931+0000","last_active":"2024-04-17T15:10:08.925505+0000","last_peered":"2024-04-17T15:10:08.925505+0000","last_clean":"2024-04-17T15:10:08.925505+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T15:10:08.925505+0000","last_undegraded":"2024-04-17T15:10:08.925505+0000","last_fullsized":"2024-04-17T15:10:08.925505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":133,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'98","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.846264+0000","last_change":"2024-04-17T14:39:59.405912+0000","last_active":"2024-04-17T15:10:08.846264+0000","last_peered":"2024-04-17T15:10:08.846264+0000","last_clean":"2024-04-17T15:10:08.846264+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T15:10:08.846264+0000","last_undegraded":"2024-04-17T15:10:08.846264+0000","last_fullsized":"2024-04-17T15:10:08.846264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:54:44.024992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3049,"num_write":71,"num_write_kb":6543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.943127+0000","last_change":"2024-04-17T14:39:59.420699+0000","last_active":"2024-04-17T15:10:08.943127+0000","last_peered":"2024-04-17T15:10:08.943127+0000","last_clean":"2024-04-17T15:10:08.943127+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T15:10:08.943127+0000","last_undegraded":"2024-04-17T15:10:08.943127+0000","last_fullsized":"2024-04-17T15:10:08.943127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":57,"num_write_kb":6003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'76","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.150989+0000","last_change":"2024-04-17T15:10:18.151009+0000","last_active":"2024-04-17T15:10:18.150989+0000","last_peered":"2024-04-17T15:10:18.150989+0000","last_clean":"2024-04-17T15:10:18.150989+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T15:10:18.150989+0000","last_undegraded":"2024-04-17T15:10:18.150989+0000","last_fullsized":"2024-04-17T15:10:18.150989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2024-04-17T15:10:18.150927+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2024-04-17T15:10:18.150927+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.150927+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:19:35.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":59,"num_write_kb":5350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'769","reported_seq":801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.712554+0000","last_change":"2024-04-17T14:39:58.266857+0000","last_active":"2024-04-17T15:10:01.712554+0000","last_peered":"2024-04-17T15:10:01.712554+0000","last_clean":"2024-04-17T15:10:01.712554+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T15:10:01.712554+0000","last_undegraded":"2024-04-17T15:10:01.712554+0000","last_fullsized":"2024-04-17T15:10:01.712554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.155206+0000","last_change":"2024-04-17T14:39:59.450578+0000","last_active":"2024-04-17T15:10:09.155206+0000","last_peered":"2024-04-17T15:10:09.155206+0000","last_clean":"2024-04-17T15:10:09.155206+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T15:10:09.155206+0000","last_undegraded":"2024-04-17T15:10:09.155206+0000","last_fullsized":"2024-04-17T15:10:09.155206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2033,"num_write":68,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'541","reported_seq":574,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:58.609774+0000","last_change":"2024-04-17T14:39:58.260030+0000","last_active":"2024-04-17T15:09:58.609774+0000","last_peered":"2024-04-17T15:09:58.609774+0000","last_clean":"2024-04-17T15:09:58.609774+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T15:09:58.609774+0000","last_undegraded":"2024-04-17T15:09:58.609774+0000","last_fullsized":"2024-04-17T15:09:58.609774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'6","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807877+0000","last_change":"2024-04-17T14:39:58.264740+0000","last_active":"2024-04-17T15:09:51.807877+0000","last_peered":"2024-04-17T15:09:51.807877+0000","last_clean":"2024-04-17T15:09:51.807877+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T15:09:51.807877+0000","last_undegraded":"2024-04-17T15:09:51.807877+0000","last_fullsized":"2024-04-17T15:09:51.807877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:09:20.163805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'97","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.120256+0000","last_change":"2024-04-17T14:39:59.429941+0000","last_active":"2024-04-17T15:10:09.120256+0000","last_peered":"2024-04-17T15:10:09.120256+0000","last_clean":"2024-04-17T15:10:09.120256+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T15:10:09.120256+0000","last_undegraded":"2024-04-17T15:10:09.120256+0000","last_fullsized":"2024-04-17T15:10:09.120256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:24:27.265540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":71,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'2","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:41.635720+0000","last_change":"2024-04-17T14:39:58.252179+0000","last_active":"2024-04-17T15:09:41.635720+0000","last_peered":"2024-04-17T15:09:41.635720+0000","last_clean":"2024-04-17T15:09:41.635720+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T15:09:41.635720+0000","last_undegraded":"2024-04-17T15:09:41.635720+0000","last_fullsized":"2024-04-17T15:09:41.635720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'85","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.151210+0000","last_change":"2024-04-17T14:39:59.405321+0000","last_active":"2024-04-17T15:10:09.151210+0000","last_peered":"2024-04-17T15:10:09.151210+0000","last_clean":"2024-04-17T15:10:09.151210+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T15:10:09.151210+0000","last_undegraded":"2024-04-17T15:10:09.151210+0000","last_fullsized":"2024-04-17T15:10:09.151210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":63,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.134787+0000","last_change":"2024-04-17T15:10:16.134808+0000","last_active":"2024-04-17T15:10:16.134787+0000","last_peered":"2024-04-17T15:10:16.134787+0000","last_clean":"2024-04-17T15:10:16.134787+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T15:10:16.134787+0000","last_undegraded":"2024-04-17T15:10:16.134787+0000","last_fullsized":"2024-04-17T15:10:16.134787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:16.134709+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:16.134709+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.134709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:41:28.548305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'95","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.951545+0000","last_change":"2024-04-17T14:39:59.414524+0000","last_active":"2024-04-17T15:10:08.951545+0000","last_peered":"2024-04-17T15:10:08.951545+0000","last_clean":"2024-04-17T15:10:08.951545+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T15:10:08.951545+0000","last_undegraded":"2024-04-17T15:10:08.951545+0000","last_fullsized":"2024-04-17T15:10:08.951545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1337,"num_write":72,"num_write_kb":6000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'3","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.752061+0000","last_change":"2024-04-17T15:10:17.752083+0000","last_active":"2024-04-17T15:10:17.752061+0000","last_peered":"2024-04-17T15:10:17.752061+0000","last_clean":"2024-04-17T15:10:17.752061+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T15:10:17.752061+0000","last_undegraded":"2024-04-17T15:10:17.752061+0000","last_fullsized":"2024-04-17T15:10:17.752061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-17T15:10:17.751988+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-17T15:10:17.751988+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.751988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:09:11.349473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'84","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.117973+0000","last_change":"2024-04-17T14:39:59.417239+0000","last_active":"2024-04-17T15:10:09.117973+0000","last_peered":"2024-04-17T15:10:09.117973+0000","last_clean":"2024-04-17T15:10:09.117973+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T15:10:09.117973+0000","last_undegraded":"2024-04-17T15:10:09.117973+0000","last_fullsized":"2024-04-17T15:10:09.117973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:35:24.899702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":59,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'394","reported_seq":426,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.784156+0000","last_change":"2024-04-17T14:39:58.241019+0000","last_active":"2024-04-17T15:10:06.784156+0000","last_peered":"2024-04-17T15:10:06.784156+0000","last_clean":"2024-04-17T15:10:06.784156+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T15:10:06.784156+0000","last_undegraded":"2024-04-17T15:10:06.784156+0000","last_fullsized":"2024-04-17T15:10:06.784156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'84","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.941213+0000","last_change":"2024-04-17T14:39:59.416887+0000","last_active":"2024-04-17T15:10:08.941213+0000","last_peered":"2024-04-17T15:10:08.941213+0000","last_clean":"2024-04-17T15:10:08.941213+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T15:10:08.941213+0000","last_undegraded":"2024-04-17T15:10:08.941213+0000","last_fullsized":"2024-04-17T15:10:08.941213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":63,"num_write_kb":3236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'928","reported_seq":969,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.868919+0000","last_change":"2024-04-17T15:10:16.868979+0000","last_active":"2024-04-17T15:10:16.868919+0000","last_peered":"2024-04-17T15:10:16.868919+0000","last_clean":"2024-04-17T15:10:16.868919+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T15:10:16.868919+0000","last_undegraded":"2024-04-17T15:10:16.868919+0000","last_fullsized":"2024-04-17T15:10:16.868919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'928","last_scrub_stamp":"2024-04-17T15:10:16.868830+0000","last_deep_scrub":"25'928","last_deep_scrub_stamp":"2024-04-17T15:10:16.868830+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.868830+0000","objects_scrubbed":4,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:20:47.991156+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":4530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'85","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.145163+0000","last_change":"2024-04-17T14:39:59.448731+0000","last_active":"2024-04-17T15:10:09.145163+0000","last_peered":"2024-04-17T15:10:09.145163+0000","last_clean":"2024-04-17T15:10:09.145163+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T15:10:09.145163+0000","last_undegraded":"2024-04-17T15:10:09.145163+0000","last_fullsized":"2024-04-17T15:10:09.145163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":66,"num_write_kb":2869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'71","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.318885+0000","last_change":"2024-04-17T14:39:58.261731+0000","last_active":"2024-04-17T15:10:09.318885+0000","last_peered":"2024-04-17T15:10:09.318885+0000","last_clean":"2024-04-17T15:10:09.318885+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T15:10:09.318885+0000","last_undegraded":"2024-04-17T15:10:09.318885+0000","last_fullsized":"2024-04-17T15:10:09.318885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":693263,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'85","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.885522+0000","last_change":"2024-04-17T14:39:59.423677+0000","last_active":"2024-04-17T15:10:08.885522+0000","last_peered":"2024-04-17T15:10:08.885522+0000","last_clean":"2024-04-17T15:10:08.885522+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T15:10:08.885522+0000","last_undegraded":"2024-04-17T15:10:08.885522+0000","last_fullsized":"2024-04-17T15:10:08.885522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:03:02.513859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1082,"num_write":62,"num_write_kb":6883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'8","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.860049+0000","last_change":"2024-04-17T14:39:58.259403+0000","last_active":"2024-04-17T15:10:16.860049+0000","last_peered":"2024-04-17T15:10:16.860049+0000","last_clean":"2024-04-17T15:10:16.860049+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T15:10:16.860049+0000","last_undegraded":"2024-04-17T15:10:16.860049+0000","last_fullsized":"2024-04-17T15:10:16.860049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'118","reported_seq":149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.941057+0000","last_change":"2024-04-17T14:39:59.447093+0000","last_active":"2024-04-17T15:10:08.941057+0000","last_peered":"2024-04-17T15:10:08.941057+0000","last_clean":"2024-04-17T15:10:08.941057+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T15:10:08.941057+0000","last_undegraded":"2024-04-17T15:10:08.941057+0000","last_fullsized":"2024-04-17T15:10:08.941057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'2","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:14.742991+0000","last_change":"2024-04-17T15:10:14.742991+0000","last_active":"2024-04-17T15:10:14.742991+0000","last_peered":"2024-04-17T15:10:14.742991+0000","last_clean":"2024-04-17T15:10:14.742991+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T15:10:14.742991+0000","last_undegraded":"2024-04-17T15:10:14.742991+0000","last_fullsized":"2024-04-17T15:10:14.742991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:14.742882+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:14.742882+0000","last_clean_scrub_stamp":"2024-04-17T15:10:14.742882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:41.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'75","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.110245+0000","last_change":"2024-04-17T15:10:17.110245+0000","last_active":"2024-04-17T15:10:17.110245+0000","last_peered":"2024-04-17T15:10:17.110245+0000","last_clean":"2024-04-17T15:10:17.110245+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T15:10:17.110245+0000","last_undegraded":"2024-04-17T15:10:17.110245+0000","last_fullsized":"2024-04-17T15:10:17.110245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-04-17T15:10:17.110147+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-04-17T15:10:17.110147+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.110147+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:20:30.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":55,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":57,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.601716+0000","last_change":"2024-04-17T15:10:18.601716+0000","last_active":"2024-04-17T15:10:18.601716+0000","last_peered":"2024-04-17T15:10:18.601716+0000","last_clean":"2024-04-17T15:10:18.601716+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T15:10:18.601716+0000","last_undegraded":"2024-04-17T15:10:18.601716+0000","last_fullsized":"2024-04-17T15:10:18.601716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-04-17T15:10:18.601402+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-04-17T15:10:18.601402+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.601402+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:29:02.817850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'81","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.709281+0000","last_change":"2024-04-17T15:10:17.709325+0000","last_active":"2024-04-17T15:10:17.709281+0000","last_peered":"2024-04-17T15:10:17.709281+0000","last_clean":"2024-04-17T15:10:17.709281+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T15:10:17.709281+0000","last_undegraded":"2024-04-17T15:10:17.709281+0000","last_fullsized":"2024-04-17T15:10:17.709281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2024-04-17T15:10:17.709193+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2024-04-17T15:10:17.709193+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.709193+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:47:07.007544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3310,"num_write":61,"num_write_kb":6412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:57.086859+0000","last_change":"2024-04-17T14:39:58.266775+0000","last_active":"2024-04-17T15:09:57.086859+0000","last_peered":"2024-04-17T15:09:57.086859+0000","last_clean":"2024-04-17T15:09:57.086859+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T15:09:57.086859+0000","last_undegraded":"2024-04-17T15:09:57.086859+0000","last_fullsized":"2024-04-17T15:09:57.086859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'45","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.951400+0000","last_change":"2024-04-17T14:39:59.445199+0000","last_active":"2024-04-17T15:10:08.951400+0000","last_peered":"2024-04-17T15:10:08.951400+0000","last_clean":"2024-04-17T15:10:08.951400+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T15:10:08.951400+0000","last_undegraded":"2024-04-17T15:10:08.951400+0000","last_fullsized":"2024-04-17T15:10:08.951400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":33,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.726684+0000","last_change":"2024-04-17T14:39:58.267004+0000","last_active":"2024-04-17T15:10:01.726684+0000","last_peered":"2024-04-17T15:10:01.726684+0000","last_clean":"2024-04-17T15:10:01.726684+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T15:10:01.726684+0000","last_undegraded":"2024-04-17T15:10:01.726684+0000","last_fullsized":"2024-04-17T15:10:01.726684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'69","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.147606+0000","last_change":"2024-04-17T14:39:59.451883+0000","last_active":"2024-04-17T15:10:09.147606+0000","last_peered":"2024-04-17T15:10:09.147606+0000","last_clean":"2024-04-17T15:10:09.147606+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T15:10:09.147606+0000","last_undegraded":"2024-04-17T15:10:09.147606+0000","last_fullsized":"2024-04-17T15:10:09.147606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":47,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'4","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.784425+0000","last_change":"2024-04-17T14:39:58.267779+0000","last_active":"2024-04-17T15:09:51.784425+0000","last_peered":"2024-04-17T15:09:51.784425+0000","last_clean":"2024-04-17T15:09:51.784425+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T15:09:51.784425+0000","last_undegraded":"2024-04-17T15:09:51.784425+0000","last_fullsized":"2024-04-17T15:09:51.784425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:32.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'94","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.146575+0000","last_change":"2024-04-17T14:39:59.446962+0000","last_active":"2024-04-17T15:10:09.146575+0000","last_peered":"2024-04-17T15:10:09.146575+0000","last_clean":"2024-04-17T15:10:09.146575+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T15:10:09.146575+0000","last_undegraded":"2024-04-17T15:10:09.146575+0000","last_fullsized":"2024-04-17T15:10:09.146575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":1779,"num_write":77,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807444+0000","last_change":"2024-04-17T14:39:58.265168+0000","last_active":"2024-04-17T15:09:51.807444+0000","last_peered":"2024-04-17T15:09:51.807444+0000","last_clean":"2024-04-17T15:09:51.807444+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T15:09:51.807444+0000","last_undegraded":"2024-04-17T15:09:51.807444+0000","last_fullsized":"2024-04-17T15:09:51.807444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:41.850033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'87","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.941499+0000","last_change":"2024-04-17T14:39:59.418726+0000","last_active":"2024-04-17T15:10:08.941499+0000","last_peered":"2024-04-17T15:10:08.941499+0000","last_clean":"2024-04-17T15:10:08.941499+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T15:10:08.941499+0000","last_undegraded":"2024-04-17T15:10:08.941499+0000","last_fullsized":"2024-04-17T15:10:08.941499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":68,"num_write_kb":2018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:15.147327+0000","last_change":"2024-04-17T15:10:15.147390+0000","last_active":"2024-04-17T15:10:15.147327+0000","last_peered":"2024-04-17T15:10:15.147327+0000","last_clean":"2024-04-17T15:10:15.147327+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T15:10:15.147327+0000","last_undegraded":"2024-04-17T15:10:15.147327+0000","last_fullsized":"2024-04-17T15:10:15.147327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-04-17T15:10:15.147208+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-04-17T15:10:15.147208+0000","last_clean_scrub_stamp":"2024-04-17T15:10:15.147208+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:25:55.619039+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'7","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.654526+0000","last_change":"2024-04-17T14:39:58.258221+0000","last_active":"2024-04-17T15:10:01.654526+0000","last_peered":"2024-04-17T15:10:01.654526+0000","last_clean":"2024-04-17T15:10:01.654526+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T15:10:01.654526+0000","last_undegraded":"2024-04-17T15:10:01.654526+0000","last_fullsized":"2024-04-17T15:10:01.654526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'90","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.149325+0000","last_change":"2024-04-17T14:39:59.404449+0000","last_active":"2024-04-17T15:10:09.149325+0000","last_peered":"2024-04-17T15:10:09.149325+0000","last_clean":"2024-04-17T15:10:09.149325+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T15:10:09.149325+0000","last_undegraded":"2024-04-17T15:10:09.149325+0000","last_fullsized":"2024-04-17T15:10:09.149325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2040,"num_write":75,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'211","reported_seq":247,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.610779+0000","last_change":"2024-04-17T14:39:58.262071+0000","last_active":"2024-04-17T15:10:08.610779+0000","last_peered":"2024-04-17T15:10:08.610779+0000","last_clean":"2024-04-17T15:10:08.610779+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T15:10:08.610779+0000","last_undegraded":"2024-04-17T15:10:08.610779+0000","last_fullsized":"2024-04-17T15:10:08.610779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'85","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.884228+0000","last_change":"2024-04-17T14:39:59.424894+0000","last_active":"2024-04-17T15:10:08.884228+0000","last_peered":"2024-04-17T15:10:08.884228+0000","last_clean":"2024-04-17T15:10:08.884228+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T15:10:08.884228+0000","last_undegraded":"2024-04-17T15:10:08.884228+0000","last_fullsized":"2024-04-17T15:10:08.884228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:41:06.363311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":73,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'624","reported_seq":1276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.059947+0000","last_change":"2024-04-17T14:39:58.259188+0000","last_active":"2024-04-17T15:10:09.059947+0000","last_peered":"2024-04-17T15:10:09.059947+0000","last_clean":"2024-04-17T15:10:09.059947+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T15:10:09.059947+0000","last_undegraded":"2024-04-17T15:10:09.059947+0000","last_fullsized":"2024-04-17T15:10:09.059947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:30:53.105778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245531,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":618,"num_read_kb":708,"num_write":620,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.120567+0000","last_change":"2024-04-17T14:39:59.278760+0000","last_active":"2024-04-17T15:10:09.120567+0000","last_peered":"2024-04-17T15:10:09.120567+0000","last_clean":"2024-04-17T15:10:09.120567+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T15:10:09.120567+0000","last_undegraded":"2024-04-17T15:10:09.120567+0000","last_fullsized":"2024-04-17T15:10:09.120567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:07.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":53,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.747507+0000","last_change":"2024-04-17T14:39:58.259392+0000","last_active":"2024-04-17T15:10:06.747507+0000","last_peered":"2024-04-17T15:10:06.747507+0000","last_clean":"2024-04-17T15:10:06.747507+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T15:10:06.747507+0000","last_undegraded":"2024-04-17T15:10:06.747507+0000","last_fullsized":"2024-04-17T15:10:06.747507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'64","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.845960+0000","last_change":"2024-04-17T14:40:10.456994+0000","last_active":"2024-04-17T15:10:08.845960+0000","last_peered":"2024-04-17T15:10:08.845960+0000","last_clean":"2024-04-17T15:10:08.845960+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T15:10:08.845960+0000","last_undegraded":"2024-04-17T15:10:08.845960+0000","last_fullsized":"2024-04-17T15:10:08.845960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:12:21.640938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":47,"num_write_kb":3555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.785304+0000","last_change":"2024-04-17T14:39:58.267757+0000","last_active":"2024-04-17T15:09:51.785304+0000","last_peered":"2024-04-17T15:09:51.785304+0000","last_clean":"2024-04-17T15:09:51.785304+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T15:09:51.785304+0000","last_undegraded":"2024-04-17T15:09:51.785304+0000","last_fullsized":"2024-04-17T15:09:51.785304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:42.738789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'80","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.942532+0000","last_change":"2024-04-17T14:39:59.420658+0000","last_active":"2024-04-17T15:10:08.942532+0000","last_peered":"2024-04-17T15:10:08.942532+0000","last_clean":"2024-04-17T15:10:08.942532+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T15:10:08.942532+0000","last_undegraded":"2024-04-17T15:10:08.942532+0000","last_fullsized":"2024-04-17T15:10:08.942532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":66,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:06.747089+0000","last_change":"2024-04-17T14:39:58.261033+0000","last_active":"2024-04-17T15:10:06.747089+0000","last_peered":"2024-04-17T15:10:06.747089+0000","last_clean":"2024-04-17T15:10:06.747089+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T15:10:06.747089+0000","last_undegraded":"2024-04-17T15:10:06.747089+0000","last_fullsized":"2024-04-17T15:10:06.747089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'85","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.887905+0000","last_change":"2024-04-17T14:39:59.432291+0000","last_active":"2024-04-17T15:10:08.887905+0000","last_peered":"2024-04-17T15:10:08.887905+0000","last_clean":"2024-04-17T15:10:08.887905+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T15:10:08.887905+0000","last_undegraded":"2024-04-17T15:10:08.887905+0000","last_fullsized":"2024-04-17T15:10:08.887905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:44:25.706525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":61,"num_write_kb":2647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1176","reported_seq":1211,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.772730+0000","last_change":"2024-04-17T14:39:58.266316+0000","last_active":"2024-04-17T15:10:17.772730+0000","last_peered":"2024-04-17T15:10:17.772730+0000","last_clean":"2024-04-17T15:10:17.772730+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T15:10:17.772730+0000","last_undegraded":"2024-04-17T15:10:17.772730+0000","last_fullsized":"2024-04-17T15:10:17.772730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2896,"num_write_kb":1176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'90","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.773063+0000","last_change":"2024-04-17T14:39:59.427736+0000","last_active":"2024-04-17T15:10:17.773063+0000","last_peered":"2024-04-17T15:10:17.773063+0000","last_clean":"2024-04-17T15:10:17.773063+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T15:10:17.773063+0000","last_undegraded":"2024-04-17T15:10:17.773063+0000","last_fullsized":"2024-04-17T15:10:17.773063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3434,"num_write":74,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'9","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.860025+0000","last_change":"2024-04-17T14:39:58.261959+0000","last_active":"2024-04-17T15:10:16.860025+0000","last_peered":"2024-04-17T15:10:16.860025+0000","last_clean":"2024-04-17T15:10:16.860025+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T15:10:16.860025+0000","last_undegraded":"2024-04-17T15:10:16.860025+0000","last_fullsized":"2024-04-17T15:10:16.860025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'76","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.772924+0000","last_change":"2024-04-17T14:39:59.277358+0000","last_active":"2024-04-17T15:10:17.772924+0000","last_peered":"2024-04-17T15:10:17.772924+0000","last_clean":"2024-04-17T15:10:17.772924+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T15:10:17.772924+0000","last_undegraded":"2024-04-17T15:10:17.772924+0000","last_fullsized":"2024-04-17T15:10:17.772924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":52,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:15.765229+0000","last_change":"2024-04-17T15:10:15.765229+0000","last_active":"2024-04-17T15:10:15.765229+0000","last_peered":"2024-04-17T15:10:15.765229+0000","last_clean":"2024-04-17T15:10:15.765229+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T15:10:15.765229+0000","last_undegraded":"2024-04-17T15:10:15.765229+0000","last_fullsized":"2024-04-17T15:10:15.765229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-17T15:10:15.765096+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-17T15:10:15.765096+0000","last_clean_scrub_stamp":"2024-04-17T15:10:15.765096+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:14:06.728153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'99","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.895047+0000","last_change":"2024-04-17T14:39:59.417695+0000","last_active":"2024-04-17T15:10:08.895047+0000","last_peered":"2024-04-17T15:10:08.895047+0000","last_clean":"2024-04-17T15:10:08.895047+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T15:10:08.895047+0000","last_undegraded":"2024-04-17T15:10:08.895047+0000","last_fullsized":"2024-04-17T15:10:08.895047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2098,"num_write":85,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.772730+0000","last_change":"2024-04-17T14:39:58.261579+0000","last_active":"2024-04-17T15:10:17.772730+0000","last_peered":"2024-04-17T15:10:17.772730+0000","last_clean":"2024-04-17T15:10:17.772730+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T15:10:17.772730+0000","last_undegraded":"2024-04-17T15:10:17.772730+0000","last_fullsized":"2024-04-17T15:10:17.772730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'72","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.773079+0000","last_change":"2024-04-17T14:39:59.277309+0000","last_active":"2024-04-17T15:10:17.773079+0000","last_peered":"2024-04-17T15:10:17.773079+0000","last_clean":"2024-04-17T15:10:17.773079+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T15:10:17.773079+0000","last_undegraded":"2024-04-17T15:10:17.773079+0000","last_fullsized":"2024-04-17T15:10:17.773079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":50,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'2","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.807732+0000","last_change":"2024-04-17T14:39:58.270743+0000","last_active":"2024-04-17T15:09:51.807732+0000","last_peered":"2024-04-17T15:09:51.807732+0000","last_clean":"2024-04-17T15:09:51.807732+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T15:09:51.807732+0000","last_undegraded":"2024-04-17T15:09:51.807732+0000","last_fullsized":"2024-04-17T15:09:51.807732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:17:56.431623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'83","reported_seq":135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.846138+0000","last_change":"2024-04-17T14:39:59.423053+0000","last_active":"2024-04-17T15:10:08.846138+0000","last_peered":"2024-04-17T15:10:08.846138+0000","last_clean":"2024-04-17T15:10:08.846138+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T15:10:08.846138+0000","last_undegraded":"2024-04-17T15:10:08.846138+0000","last_fullsized":"2024-04-17T15:10:08.846138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:28:04.630286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":67,"num_write_kb":4068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'778","reported_seq":812,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:01.653309+0000","last_change":"2024-04-17T14:39:58.254205+0000","last_active":"2024-04-17T15:10:01.653309+0000","last_peered":"2024-04-17T15:10:01.653309+0000","last_clean":"2024-04-17T15:10:01.653309+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T15:10:01.653309+0000","last_undegraded":"2024-04-17T15:10:01.653309+0000","last_fullsized":"2024-04-17T15:10:01.653309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'124","reported_seq":165,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.941134+0000","last_change":"2024-04-17T14:39:59.417451+0000","last_active":"2024-04-17T15:10:08.941134+0000","last_peered":"2024-04-17T15:10:08.941134+0000","last_clean":"2024-04-17T15:10:08.941134+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T15:10:08.941134+0000","last_undegraded":"2024-04-17T15:10:08.941134+0000","last_fullsized":"2024-04-17T15:10:08.941134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":110,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'91","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:08.932047+0000","last_change":"2024-04-17T14:39:59.445896+0000","last_active":"2024-04-17T15:10:08.932047+0000","last_peered":"2024-04-17T15:10:08.932047+0000","last_clean":"2024-04-17T15:10:08.932047+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T15:10:08.932047+0000","last_undegraded":"2024-04-17T15:10:08.932047+0000","last_fullsized":"2024-04-17T15:10:08.932047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2294,"num_write":58,"num_write_kb":5884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:58.636194+0000","last_change":"2024-04-17T14:39:58.258034+0000","last_active":"2024-04-17T15:09:58.636194+0000","last_peered":"2024-04-17T15:09:58.636194+0000","last_clean":"2024-04-17T15:09:58.636194+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T15:09:58.636194+0000","last_undegraded":"2024-04-17T15:09:58.636194+0000","last_fullsized":"2024-04-17T15:09:58.636194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'71","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.357192+0000","last_change":"2024-04-17T14:39:59.449017+0000","last_active":"2024-04-17T15:10:09.357192+0000","last_peered":"2024-04-17T15:10:09.357192+0000","last_clean":"2024-04-17T15:10:09.357192+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T15:10:09.357192+0000","last_undegraded":"2024-04-17T15:10:09.357192+0000","last_fullsized":"2024-04-17T15:10:09.357192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":47,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1269","reported_seq":1310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.794959+0000","last_change":"2024-04-17T15:10:16.795043+0000","last_active":"2024-04-17T15:10:16.794959+0000","last_peered":"2024-04-17T15:10:16.794959+0000","last_clean":"2024-04-17T15:10:16.794959+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T15:10:16.794959+0000","last_undegraded":"2024-04-17T15:10:16.794959+0000","last_fullsized":"2024-04-17T15:10:16.794959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1269","last_scrub_stamp":"2024-04-17T15:10:16.794873+0000","last_deep_scrub":"25'1269","last_deep_scrub_stamp":"2024-04-17T15:10:16.794873+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.794873+0000","objects_scrubbed":3,"log_size":1269,"log_dups_size":0,"ondisk_log_size":1269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:23.916337+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":8829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'122","reported_seq":173,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.118467+0000","last_change":"2024-04-17T14:39:59.406005+0000","last_active":"2024-04-17T15:10:09.118467+0000","last_peered":"2024-04-17T15:10:09.118467+0000","last_clean":"2024-04-17T15:10:09.118467+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T15:10:09.118467+0000","last_undegraded":"2024-04-17T15:10:09.118467+0000","last_fullsized":"2024-04-17T15:10:09.118467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:38:58.344796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":107,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'779","reported_seq":814,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.786148+0000","last_change":"2024-04-17T14:39:58.264670+0000","last_active":"2024-04-17T15:09:51.786148+0000","last_peered":"2024-04-17T15:09:51.786148+0000","last_clean":"2024-04-17T15:09:51.786148+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T15:09:51.786148+0000","last_undegraded":"2024-04-17T15:09:51.786148+0000","last_fullsized":"2024-04-17T15:09:51.786148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:45:10.374575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'95","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:09.110549+0000","last_change":"2024-04-17T14:39:59.404330+0000","last_active":"2024-04-17T15:10:09.110549+0000","last_peered":"2024-04-17T15:10:09.110549+0000","last_clean":"2024-04-17T15:10:09.110549+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T15:10:09.110549+0000","last_undegraded":"2024-04-17T15:10:09.110549+0000","last_fullsized":"2024-04-17T15:10:09.110549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:58.098839+0000","last_clean_scrub_stamp":"2024-04-17T14:39:58.098839+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:13:50.567152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":83,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'707","reported_seq":742,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:09:51.813501+0000","last_change":"2024-04-17T14:39:58.258550+0000","last_active":"2024-04-17T15:09:51.813501+0000","last_peered":"2024-04-17T15:09:51.813501+0000","last_clean":"2024-04-17T15:09:51.813501+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T15:09:51.813501+0000","last_undegraded":"2024-04-17T15:09:51.813501+0000","last_fullsized":"2024-04-17T15:09:51.813501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T14:39:57.052466+0000","last_clean_scrub_stamp":"2024-04-17T14:39:57.052466+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":137179,"num_write":4261,"num_write_kb":326145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5536,"ondisk_log_size":5536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38688966,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":618,"num_read_kb":708,"num_write":9934,"num_write_kb":42607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77438976,"data_stored":77377932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8345,"ondisk_log_size":8345,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509817,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":4452352,"data_stored":4288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":8460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":8663040,"data_stored":8484412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509818,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43656,"kb_used_data":16640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328184,"statfs":{"total":96636764160,"available":96592060416,"internally_reserved":0,"allocated":17039360,"data_stored":16872258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509816,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52108,"kb_used_data":8452,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319732,"statfs":{"total":96636764160,"available":96583405568,"internally_reserved":0,"allocated":8654848,"data_stored":8483740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509817,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48524,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323316,"statfs":{"total":96636764160,"available":96587075584,"internally_reserved":0,"allocated":9244672,"data_stored":9073506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509817,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44404,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327436,"statfs":{"total":96636764160,"available":96591294464,"internally_reserved":0,"allocated":13545472,"data_stored":13370657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542519,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":5276,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":5402624,"data_stored":5227648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542520,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40384,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":13688832,"data_stored":13513363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13287424,"data_stored":13276197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12836864,"data_stored":12828535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5144576,"data_stored":5133188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:10:21.316 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.316 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.316 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.316 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.316 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.317 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.318 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.319 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.320 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.321 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.322 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.323 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.324 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.325 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.325 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.325 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-17T14:39:58.098839+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=58, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.325 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-17T14:39:57.052466+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=14, tm_min=39, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=10, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:10:21.325 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T15:10:35.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:10:35.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:10:41.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:10:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.475+0000 7f4253600640 1 Processor -- start 2024-04-17T15:10:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.475+0000 7f4253600640 1 -- start start 2024-04-17T15:10:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4253600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f424c0aebc0 0x7f424c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4253600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f424c15b8e0 con 0x7f424c154f80 2024-04-17T15:10:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4253600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f424c15bbc0 con 0x7f424c0c9cd0 2024-04-17T15:10:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4253600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f424c0c8f10 con 0x7f424c0aebc0 2024-04-17T15:10:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4250c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f424c154f80 0x7f424c0c3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44792/0 (socket says 172.21.15.16:44792) 2024-04-17T15:10:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4250c00640 1 -- 172.21.15.16:0/3080272643 learned_addr learned my addr 172.21.15.16:0/3080272643 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.479+0000 7f4251600640 1 --2- 172.21.15.16:0/3080272643 >> v2:172.21.15.67:3300/0 conn(0x7f424c0aebc0 0x7f424c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.483+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516229765 0 0) 0x7f424c15b8e0 con 0x7f424c154f80 2024-04-17T15:10:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.483+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4234003530 con 0x7f424c154f80 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1530257919 0 0) 0x7f4234003530 con 0x7f424c154f80 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 >> v2:172.21.15.67:3300/0 conn(0x7f424c0aebc0 msgr2=0x7f424c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 --2- 172.21.15.16:0/3080272643 >> v2:172.21.15.67:3300/0 conn(0x7f424c0aebc0 0x7f424c15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 >> v1:172.21.15.67:6789/0 conn(0x7f424c0c9cd0 legacy=0x7f424c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424c0c91f0 con 0x7f424c154f80 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f4240001680 con 0x7f424c154f80 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 >> v1:172.21.15.16:6789/0 conn(0x7f424c154f80 legacy=0x7f424c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234003a10 0x7f4234003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 0x7f4234004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42340051d0 0x7f423400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f424c0c8f10 con 0x7f4234004810 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f423400c0a0 con 0x7f42340051d0 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f423400c2a0 con 0x7f4234003a10 2024-04-17T15:10:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.487+0000 7f4250c00640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234003a10 0x7f4234003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 0x7f4234004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 -- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234003a10 msgr2=0x7f4234003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234003a10 0x7f4234003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 -- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42340051d0 msgr2=0x7f423400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42340051d0 0x7f423400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f424be00640 1 -- 172.21.15.16:0/3080272643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4234003530 con 0x7f4234004810 2024-04-17T15:10:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.491+0000 7f4251600640 1 -- 172.21.15.16:0/3080272643 reap_dead start 2024-04-17T15:10:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.495+0000 7f424be00640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 0x7f4234004c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4238003db0 tx=0x7f423801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e84a25891955af server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b0070 con 0x7f4234004810 2024-04-17T15:10:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42380ab620 con 0x7f4234004810 2024-04-17T15:10:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f424b400640 1 -- 172.21.15.16:0/3080272643 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380039b0 con 0x7f4234004810 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 -- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 msgr2=0x7f4234004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 0x7f4234004c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4238003db0 tx=0x7f423801c320 comp rx=0 tx=0).stop 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 -- 172.21.15.16:0/3080272643 shutdown_connections 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 --2- 172.21.15.16:0/3080272643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4234004810 0x7f4234004c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 -- 172.21.15.16:0/3080272643 >> 172.21.15.16:0/3080272643 conn(0x7f424c0716a0 msgr2=0x7f424c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 -- 172.21.15.16:0/3080272643 shutdown_connections 2024-04-17T15:10:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.499+0000 7f4253600640 1 -- 172.21.15.16:0/3080272643 wait complete. 2024-04-17T15:10:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 Processor -- start 2024-04-17T15:10:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 -- start start 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234004810 0x7f424c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f424c0c8460 0x7f424c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f424c0aefe0 con 0x7f424c1f18c0 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f424c0c97b0 con 0x7f424c0c8460 2024-04-17T15:10:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4253600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f424c155360 con 0x7f4234004810 2024-04-17T15:10:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4251600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4251600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54492/0 (socket says 172.21.15.16:54492) 2024-04-17T15:10:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.503+0000 7f4251600640 1 -- 172.21.15.16:0/3426837579 learned_addr learned my addr 172.21.15.16:0/3426837579 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f424be00640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f424c0c8460 0x7f424c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4250c00640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234004810 0x7f424c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4251600640 1 -- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234004810 msgr2=0x7f424c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4251600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234004810 0x7f424c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4251600640 1 -- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f424c0c8460 msgr2=0x7f424c150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4251600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f424c0c8460 0x7f424c150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.507+0000 7f4251600640 1 -- 172.21.15.16:0/3426837579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424c1f2280 con 0x7f424c1f18c0 2024-04-17T15:10:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.511+0000 7f4251600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f424c0caca0 tx=0x7f424400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424400ba50 con 0x7f424c1f18c0 2024-04-17T15:10:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424401a070 con 0x7f424c1f18c0 2024-04-17T15:10:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424400be50 con 0x7f424c1f18c0 2024-04-17T15:10:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424c0c7160 con 0x7f424c1f18c0 2024-04-17T15:10:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f424c0c7400 con 0x7f424c1f18c0 2024-04-17T15:10:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.515+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f424c076280 con 0x7f424c1f18c0 2024-04-17T15:10:41.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.535+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4244013070 con 0x7f424c1f18c0 2024-04-17T15:10:41.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.535+0000 7f4248c00640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 0x7f422c06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:41.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.535+0000 7f4250c00640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 0x7f422c06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:41.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.539+0000 7f4250c00640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 0x7f422c06aa30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4240001060 tx=0x7f4240001de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.795+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f42440554f0 con 0x7f424c1f18c0 2024-04-17T15:10:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:41.795+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f424c1f2280 con 0x7f424c1f18c0 2024-04-17T15:10:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.007+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 --> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f424c1f1710 con 0x7f422c068570 2024-04-17T15:10:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.023+0000 7f4248c00640 1 -- 172.21.15.16:0/3426837579 <== mgr.4105 v2:172.21.15.67:6800/3551347273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253439 (secure 0 0 0) 0x7f424c1f1710 con 0x7f422c068570 2024-04-17T15:10:42.028 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:42.030 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 msgr2=0x7f422c06aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 0x7f422c06aa30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4240001060 tx=0x7f4240001de0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 msgr2=0x7f424c1f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f424c0caca0 tx=0x7f424400ee90 comp rx=0 tx=0).stop 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 shutdown_connections 2024-04-17T15:10:42.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f422c068570 0x7f422c06aa30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f424c1f18c0 0x7f424c1f1d40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f424c0c8460 0x7f424c150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 --2- 172.21.15.16:0/3426837579 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4234004810 0x7f424c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 >> 172.21.15.16:0/3426837579 conn(0x7f424c0716a0 msgr2=0x7f424c0c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 shutdown_connections 2024-04-17T15:10:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.027+0000 7f4253600640 1 -- 172.21.15.16:0/3426837579 wait complete. 2024-04-17T15:10:42.049 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":962,"stamp":"2024-04-17T15:10:41.728031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39279334,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1260,"num_read_kb":137987,"num_write":14354,"num_write_kb":371168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14017,"ondisk_log_size":14017,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":350416,"kb_used_data":78800,"kb_used_omap":12,"kb_used_meta":271539,"kb_avail":754624304,"statfs":{"total":773094113280,"available":772735287296,"internally_reserved":0,"allocated":80691200,"data_stored":79314348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":278056496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004639"},"pg_stats":[{"pgid":"3.3f","version":"25'63","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.825835+0000","last_change":"2024-04-17T15:10:24.825856+0000","last_active":"2024-04-17T15:10:24.825835+0000","last_peered":"2024-04-17T15:10:24.825835+0000","last_clean":"2024-04-17T15:10:24.825835+0000","last_became_active":"2024-04-17T14:39:59.447145+0000","last_became_peered":"2024-04-17T14:39:59.447145+0000","last_unstale":"2024-04-17T15:10:24.825835+0000","last_undegraded":"2024-04-17T15:10:24.825835+0000","last_fullsized":"2024-04-17T15:10:24.825835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'63","last_scrub_stamp":"2024-04-17T15:10:24.825749+0000","last_deep_scrub":"25'63","last_deep_scrub_stamp":"2024-04-17T15:10:24.825749+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.825749+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:46.409329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":45,"num_write_kb":3409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'73","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:31.198833+0000","last_change":"2024-04-17T15:10:31.198892+0000","last_active":"2024-04-17T15:10:31.198833+0000","last_peered":"2024-04-17T15:10:31.198833+0000","last_clean":"2024-04-17T15:10:31.198833+0000","last_became_active":"2024-04-17T14:39:59.425278+0000","last_became_peered":"2024-04-17T14:39:59.425278+0000","last_unstale":"2024-04-17T15:10:31.198833+0000","last_undegraded":"2024-04-17T15:10:31.198833+0000","last_fullsized":"2024-04-17T15:10:31.198833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-04-17T15:10:31.198628+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-04-17T15:10:31.198628+0000","last_clean_scrub_stamp":"2024-04-17T15:10:31.198628+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:32.650737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":60,"num_write_kb":3465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'84","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.120291+0000","last_change":"2024-04-17T15:10:25.120357+0000","last_active":"2024-04-17T15:10:25.120291+0000","last_peered":"2024-04-17T15:10:25.120291+0000","last_clean":"2024-04-17T15:10:25.120291+0000","last_became_active":"2024-04-17T14:39:59.281812+0000","last_became_peered":"2024-04-17T14:39:59.281812+0000","last_unstale":"2024-04-17T15:10:25.120291+0000","last_undegraded":"2024-04-17T15:10:25.120291+0000","last_fullsized":"2024-04-17T15:10:25.120291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-04-17T15:10:25.120087+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-04-17T15:10:25.120087+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.120087+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:41:31.370451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":2861,"num_write":63,"num_write_kb":6749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'56","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.817921+0000","last_change":"2024-04-17T15:10:17.817942+0000","last_active":"2024-04-17T15:10:17.817921+0000","last_peered":"2024-04-17T15:10:17.817921+0000","last_clean":"2024-04-17T15:10:17.817921+0000","last_became_active":"2024-04-17T14:39:59.400337+0000","last_became_peered":"2024-04-17T14:39:59.400337+0000","last_unstale":"2024-04-17T15:10:17.817921+0000","last_undegraded":"2024-04-17T15:10:17.817921+0000","last_fullsized":"2024-04-17T15:10:17.817921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-04-17T15:10:17.817843+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-04-17T15:10:17.817843+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.817843+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:22:21.592689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'98","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.811398+0000","last_change":"2024-04-17T15:10:22.811420+0000","last_active":"2024-04-17T15:10:22.811398+0000","last_peered":"2024-04-17T15:10:22.811398+0000","last_clean":"2024-04-17T15:10:22.811398+0000","last_became_active":"2024-04-17T14:39:59.447580+0000","last_became_peered":"2024-04-17T14:39:59.447580+0000","last_unstale":"2024-04-17T15:10:22.811398+0000","last_undegraded":"2024-04-17T15:10:22.811398+0000","last_fullsized":"2024-04-17T15:10:22.811398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'98","last_scrub_stamp":"2024-04-17T15:10:22.811314+0000","last_deep_scrub":"25'98","last_deep_scrub_stamp":"2024-04-17T15:10:22.811314+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.811314+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:26:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2548,"num_write":80,"num_write_kb":4150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'98","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.812986+0000","last_change":"2024-04-17T15:10:18.813006+0000","last_active":"2024-04-17T15:10:18.812986+0000","last_peered":"2024-04-17T15:10:18.812986+0000","last_clean":"2024-04-17T15:10:18.812986+0000","last_became_active":"2024-04-17T14:39:59.405064+0000","last_became_peered":"2024-04-17T14:39:59.405064+0000","last_unstale":"2024-04-17T15:10:18.812986+0000","last_undegraded":"2024-04-17T15:10:18.812986+0000","last_fullsized":"2024-04-17T15:10:18.812986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'98","last_scrub_stamp":"2024-04-17T15:10:18.812916+0000","last_deep_scrub":"25'98","last_deep_scrub_stamp":"2024-04-17T15:10:18.812916+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.812916+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:12:21.355632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":80,"num_write_kb":2528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'101","reported_seq":147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.761628+0000","last_change":"2024-04-17T15:10:21.761649+0000","last_active":"2024-04-17T15:10:21.761628+0000","last_peered":"2024-04-17T15:10:21.761628+0000","last_clean":"2024-04-17T15:10:21.761628+0000","last_became_active":"2024-04-17T14:39:59.446623+0000","last_became_peered":"2024-04-17T14:39:59.446623+0000","last_unstale":"2024-04-17T15:10:21.761628+0000","last_undegraded":"2024-04-17T15:10:21.761628+0000","last_fullsized":"2024-04-17T15:10:21.761628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'101","last_scrub_stamp":"2024-04-17T15:10:21.761556+0000","last_deep_scrub":"25'101","last_deep_scrub_stamp":"2024-04-17T15:10:21.761556+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.761556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:20.769429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":86,"num_write_kb":7600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'79","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:33.256698+0000","last_change":"2024-04-17T15:10:33.256844+0000","last_active":"2024-04-17T15:10:33.256698+0000","last_peered":"2024-04-17T15:10:33.256698+0000","last_clean":"2024-04-17T15:10:33.256698+0000","last_became_active":"2024-04-17T14:39:59.447628+0000","last_became_peered":"2024-04-17T14:39:59.447628+0000","last_unstale":"2024-04-17T15:10:33.256698+0000","last_undegraded":"2024-04-17T15:10:33.256698+0000","last_fullsized":"2024-04-17T15:10:33.256698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2024-04-17T15:10:33.256438+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2024-04-17T15:10:33.256438+0000","last_clean_scrub_stamp":"2024-04-17T15:10:33.256438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:51:47.703316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1525,"num_write":67,"num_write_kb":3989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'88","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.167497+0000","last_change":"2024-04-17T15:10:19.167538+0000","last_active":"2024-04-17T15:10:19.167497+0000","last_peered":"2024-04-17T15:10:19.167497+0000","last_clean":"2024-04-17T15:10:19.167497+0000","last_became_active":"2024-04-17T14:39:59.415232+0000","last_became_peered":"2024-04-17T14:39:59.415232+0000","last_unstale":"2024-04-17T15:10:19.167497+0000","last_undegraded":"2024-04-17T15:10:19.167497+0000","last_fullsized":"2024-04-17T15:10:19.167497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2024-04-17T15:10:19.167397+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2024-04-17T15:10:19.167397+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.167397+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:12:21.710112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":58,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'91","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.792368+0000","last_change":"2024-04-17T15:10:25.792388+0000","last_active":"2024-04-17T15:10:25.792368+0000","last_peered":"2024-04-17T15:10:25.792368+0000","last_clean":"2024-04-17T15:10:25.792368+0000","last_became_active":"2024-04-17T14:39:59.449850+0000","last_became_peered":"2024-04-17T14:39:59.449850+0000","last_unstale":"2024-04-17T15:10:25.792368+0000","last_undegraded":"2024-04-17T15:10:25.792368+0000","last_fullsized":"2024-04-17T15:10:25.792368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'91","last_scrub_stamp":"2024-04-17T15:10:25.792291+0000","last_deep_scrub":"25'91","last_deep_scrub_stamp":"2024-04-17T15:10:25.792291+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.792291+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:18:39.800301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2032,"num_write":61,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'90","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.782204+0000","last_change":"2024-04-17T15:10:26.782225+0000","last_active":"2024-04-17T15:10:26.782204+0000","last_peered":"2024-04-17T15:10:26.782204+0000","last_clean":"2024-04-17T15:10:26.782204+0000","last_became_active":"2024-04-17T14:39:59.450898+0000","last_became_peered":"2024-04-17T14:39:59.450898+0000","last_unstale":"2024-04-17T15:10:26.782204+0000","last_undegraded":"2024-04-17T15:10:26.782204+0000","last_fullsized":"2024-04-17T15:10:26.782204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2024-04-17T15:10:26.782125+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2024-04-17T15:10:26.782125+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.782125+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:55:24.667025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":68,"num_write_kb":6389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'61","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:27.742036+0000","last_change":"2024-04-17T15:10:27.742060+0000","last_active":"2024-04-17T15:10:27.742036+0000","last_peered":"2024-04-17T15:10:27.742036+0000","last_clean":"2024-04-17T15:10:27.742036+0000","last_became_active":"2024-04-17T14:39:59.450571+0000","last_became_peered":"2024-04-17T14:39:59.450571+0000","last_unstale":"2024-04-17T15:10:27.742036+0000","last_undegraded":"2024-04-17T15:10:27.742036+0000","last_fullsized":"2024-04-17T15:10:27.742036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'61","last_scrub_stamp":"2024-04-17T15:10:27.741959+0000","last_deep_scrub":"25'61","last_deep_scrub_stamp":"2024-04-17T15:10:27.741959+0000","last_clean_scrub_stamp":"2024-04-17T15:10:27.741959+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:16:05.180510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":46,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'64","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:28.810683+0000","last_change":"2024-04-17T15:10:28.810788+0000","last_active":"2024-04-17T15:10:28.810683+0000","last_peered":"2024-04-17T15:10:28.810683+0000","last_clean":"2024-04-17T15:10:28.810683+0000","last_became_active":"2024-04-17T14:39:59.449716+0000","last_became_peered":"2024-04-17T14:39:59.449716+0000","last_unstale":"2024-04-17T15:10:28.810683+0000","last_undegraded":"2024-04-17T15:10:28.810683+0000","last_fullsized":"2024-04-17T15:10:28.810683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-04-17T15:10:28.810426+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-04-17T15:10:28.810426+0000","last_clean_scrub_stamp":"2024-04-17T15:10:28.810426+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:56.403802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":41,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'86","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.841102+0000","last_change":"2024-04-17T15:10:24.841163+0000","last_active":"2024-04-17T15:10:24.841102+0000","last_peered":"2024-04-17T15:10:24.841102+0000","last_clean":"2024-04-17T15:10:24.841102+0000","last_became_active":"2024-04-17T14:39:59.425706+0000","last_became_peered":"2024-04-17T14:39:59.425706+0000","last_unstale":"2024-04-17T15:10:24.841102+0000","last_undegraded":"2024-04-17T15:10:24.841102+0000","last_fullsized":"2024-04-17T15:10:24.841102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-04-17T15:10:24.840882+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-04-17T15:10:24.840882+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.840882+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:23:02.834827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":67,"num_write_kb":3643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'88","reported_seq":154,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:34.276807+0000","last_change":"2024-04-17T15:10:34.276961+0000","last_active":"2024-04-17T15:10:34.276807+0000","last_peered":"2024-04-17T15:10:34.276807+0000","last_clean":"2024-04-17T15:10:34.276807+0000","last_became_active":"2024-04-17T14:39:59.447520+0000","last_became_peered":"2024-04-17T14:39:59.447520+0000","last_unstale":"2024-04-17T15:10:34.276807+0000","last_undegraded":"2024-04-17T15:10:34.276807+0000","last_fullsized":"2024-04-17T15:10:34.276807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'88","last_scrub_stamp":"2024-04-17T15:10:34.276576+0000","last_deep_scrub":"25'88","last_deep_scrub_stamp":"2024-04-17T15:10:34.276576+0000","last_clean_scrub_stamp":"2024-04-17T15:10:34.276576+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:38.586405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6351,"num_write":71,"num_write_kb":4827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'97","reported_seq":147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.661289+0000","last_change":"2024-04-17T15:10:19.661289+0000","last_active":"2024-04-17T15:10:19.661289+0000","last_peered":"2024-04-17T15:10:19.661289+0000","last_clean":"2024-04-17T15:10:19.661289+0000","last_became_active":"2024-04-17T14:39:59.414905+0000","last_became_peered":"2024-04-17T14:39:59.414905+0000","last_unstale":"2024-04-17T15:10:19.661289+0000","last_undegraded":"2024-04-17T15:10:19.661289+0000","last_fullsized":"2024-04-17T15:10:19.661289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2024-04-17T15:10:19.661196+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2024-04-17T15:10:19.661196+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.661196+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:55.387598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2606,"num_write":80,"num_write_kb":5984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'85","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:36.736890+0000","last_change":"2024-04-17T15:10:36.736916+0000","last_active":"2024-04-17T15:10:36.736890+0000","last_peered":"2024-04-17T15:10:36.736890+0000","last_clean":"2024-04-17T15:10:36.736890+0000","last_became_active":"2024-04-17T14:39:59.445620+0000","last_became_peered":"2024-04-17T14:39:59.445620+0000","last_unstale":"2024-04-17T15:10:36.736890+0000","last_undegraded":"2024-04-17T15:10:36.736890+0000","last_fullsized":"2024-04-17T15:10:36.736890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:36.736793+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:36.736793+0000","last_clean_scrub_stamp":"2024-04-17T15:10:36.736793+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:41:30.657195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":64,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'92","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.972775+0000","last_change":"2024-04-17T15:10:23.972837+0000","last_active":"2024-04-17T15:10:23.972775+0000","last_peered":"2024-04-17T15:10:23.972775+0000","last_clean":"2024-04-17T15:10:23.972775+0000","last_became_active":"2024-04-17T14:39:59.404386+0000","last_became_peered":"2024-04-17T14:39:59.404386+0000","last_unstale":"2024-04-17T15:10:23.972775+0000","last_undegraded":"2024-04-17T15:10:23.972775+0000","last_fullsized":"2024-04-17T15:10:23.972775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'92","last_scrub_stamp":"2024-04-17T15:10:23.972560+0000","last_deep_scrub":"25'92","last_deep_scrub_stamp":"2024-04-17T15:10:23.972560+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.972560+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:27.172695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":64,"num_write_kb":5955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'74","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:31.654251+0000","last_change":"2024-04-17T15:10:31.654278+0000","last_active":"2024-04-17T15:10:31.654251+0000","last_peered":"2024-04-17T15:10:31.654251+0000","last_clean":"2024-04-17T15:10:31.654251+0000","last_became_active":"2024-04-17T14:39:59.417901+0000","last_became_peered":"2024-04-17T14:39:59.417901+0000","last_unstale":"2024-04-17T15:10:31.654251+0000","last_undegraded":"2024-04-17T15:10:31.654251+0000","last_fullsized":"2024-04-17T15:10:31.654251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-04-17T15:10:31.654153+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-04-17T15:10:31.654153+0000","last_clean_scrub_stamp":"2024-04-17T15:10:31.654153+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:24:01.697607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1778,"num_write":51,"num_write_kb":3336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'113","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:28.758249+0000","last_change":"2024-04-17T15:10:28.758270+0000","last_active":"2024-04-17T15:10:28.758249+0000","last_peered":"2024-04-17T15:10:28.758249+0000","last_clean":"2024-04-17T15:10:28.758249+0000","last_became_active":"2024-04-17T14:39:59.450941+0000","last_became_peered":"2024-04-17T14:39:59.450941+0000","last_unstale":"2024-04-17T15:10:28.758249+0000","last_undegraded":"2024-04-17T15:10:28.758249+0000","last_fullsized":"2024-04-17T15:10:28.758249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'113","last_scrub_stamp":"2024-04-17T15:10:28.758176+0000","last_deep_scrub":"25'113","last_deep_scrub_stamp":"2024-04-17T15:10:28.758176+0000","last_clean_scrub_stamp":"2024-04-17T15:10:28.758176+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:59:45.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":94,"num_write_kb":5313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'107","reported_seq":156,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:27.606578+0000","last_change":"2024-04-17T15:10:27.606655+0000","last_active":"2024-04-17T15:10:27.606578+0000","last_peered":"2024-04-17T15:10:27.606578+0000","last_clean":"2024-04-17T15:10:27.606578+0000","last_became_active":"2024-04-17T14:39:59.405240+0000","last_became_peered":"2024-04-17T14:39:59.405240+0000","last_unstale":"2024-04-17T15:10:27.606578+0000","last_undegraded":"2024-04-17T15:10:27.606578+0000","last_fullsized":"2024-04-17T15:10:27.606578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'107","last_scrub_stamp":"2024-04-17T15:10:27.606302+0000","last_deep_scrub":"25'107","last_deep_scrub_stamp":"2024-04-17T15:10:27.606302+0000","last_clean_scrub_stamp":"2024-04-17T15:10:27.606302+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:30.630602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":82,"num_write_kb":4804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'83","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.100551+0000","last_change":"2024-04-17T15:10:21.100611+0000","last_active":"2024-04-17T15:10:21.100551+0000","last_peered":"2024-04-17T15:10:21.100551+0000","last_clean":"2024-04-17T15:10:21.100551+0000","last_became_active":"2024-04-17T14:39:59.448862+0000","last_became_peered":"2024-04-17T14:39:59.448862+0000","last_unstale":"2024-04-17T15:10:21.100551+0000","last_undegraded":"2024-04-17T15:10:21.100551+0000","last_fullsized":"2024-04-17T15:10:21.100551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2024-04-17T15:10:21.100465+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2024-04-17T15:10:21.100465+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.100465+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:29:05.316913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":63,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'80","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:27.162701+0000","last_change":"2024-04-17T15:10:27.162837+0000","last_active":"2024-04-17T15:10:27.162701+0000","last_peered":"2024-04-17T15:10:27.162701+0000","last_clean":"2024-04-17T15:10:27.162701+0000","last_became_active":"2024-04-17T14:39:59.404171+0000","last_became_peered":"2024-04-17T14:39:59.404171+0000","last_unstale":"2024-04-17T15:10:27.162701+0000","last_undegraded":"2024-04-17T15:10:27.162701+0000","last_fullsized":"2024-04-17T15:10:27.162701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'80","last_scrub_stamp":"2024-04-17T15:10:27.162440+0000","last_deep_scrub":"25'80","last_deep_scrub_stamp":"2024-04-17T15:10:27.162440+0000","last_clean_scrub_stamp":"2024-04-17T15:10:27.162440+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:12.559613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":54,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'61","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:34.744219+0000","last_change":"2024-04-17T15:10:34.744245+0000","last_active":"2024-04-17T15:10:34.744219+0000","last_peered":"2024-04-17T15:10:34.744219+0000","last_clean":"2024-04-17T15:10:34.744219+0000","last_became_active":"2024-04-17T14:39:59.422250+0000","last_became_peered":"2024-04-17T14:39:59.422250+0000","last_unstale":"2024-04-17T15:10:34.744219+0000","last_undegraded":"2024-04-17T15:10:34.744219+0000","last_fullsized":"2024-04-17T15:10:34.744219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'61","last_scrub_stamp":"2024-04-17T15:10:34.744121+0000","last_deep_scrub":"25'61","last_deep_scrub_stamp":"2024-04-17T15:10:34.744121+0000","last_clean_scrub_stamp":"2024-04-17T15:10:34.744121+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:27:36.497466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":45,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'90","reported_seq":145,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:29.223913+0000","last_change":"2024-04-17T15:10:29.223973+0000","last_active":"2024-04-17T15:10:29.223913+0000","last_peered":"2024-04-17T15:10:29.223913+0000","last_clean":"2024-04-17T15:10:29.223913+0000","last_became_active":"2024-04-17T14:39:59.405831+0000","last_became_peered":"2024-04-17T14:39:59.405831+0000","last_unstale":"2024-04-17T15:10:29.223913+0000","last_undegraded":"2024-04-17T15:10:29.223913+0000","last_fullsized":"2024-04-17T15:10:29.223913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2024-04-17T15:10:29.223704+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2024-04-17T15:10:29.223704+0000","last_clean_scrub_stamp":"2024-04-17T15:10:29.223704+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:59.178044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3556,"num_write":81,"num_write_kb":3963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'93","reported_seq":146,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.871250+0000","last_change":"2024-04-17T15:10:20.871270+0000","last_active":"2024-04-17T15:10:20.871250+0000","last_peered":"2024-04-17T15:10:20.871250+0000","last_clean":"2024-04-17T15:10:20.871250+0000","last_became_active":"2024-04-17T14:39:59.417087+0000","last_became_peered":"2024-04-17T14:39:59.417087+0000","last_unstale":"2024-04-17T15:10:20.871250+0000","last_undegraded":"2024-04-17T15:10:20.871250+0000","last_fullsized":"2024-04-17T15:10:20.871250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'93","last_scrub_stamp":"2024-04-17T15:10:20.871173+0000","last_deep_scrub":"25'93","last_deep_scrub_stamp":"2024-04-17T15:10:20.871173+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.871173+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:25:14.097560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":63,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'125","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.863189+0000","last_change":"2024-04-17T15:10:25.863260+0000","last_active":"2024-04-17T15:10:25.863189+0000","last_peered":"2024-04-17T15:10:25.863189+0000","last_clean":"2024-04-17T15:10:25.863189+0000","last_became_active":"2024-04-17T14:39:59.428268+0000","last_became_peered":"2024-04-17T14:39:59.428268+0000","last_unstale":"2024-04-17T15:10:25.863189+0000","last_undegraded":"2024-04-17T15:10:25.863189+0000","last_fullsized":"2024-04-17T15:10:25.863189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'125","last_scrub_stamp":"2024-04-17T15:10:25.862963+0000","last_deep_scrub":"25'125","last_deep_scrub_stamp":"2024-04-17T15:10:25.862963+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.862963+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:52.760181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":109,"num_write_kb":10749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'59","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:27.860208+0000","last_change":"2024-04-17T15:10:27.860271+0000","last_active":"2024-04-17T15:10:27.860208+0000","last_peered":"2024-04-17T15:10:27.860208+0000","last_clean":"2024-04-17T15:10:27.860208+0000","last_became_active":"2024-04-17T14:39:59.447723+0000","last_became_peered":"2024-04-17T14:39:59.447723+0000","last_unstale":"2024-04-17T15:10:27.860208+0000","last_undegraded":"2024-04-17T15:10:27.860208+0000","last_fullsized":"2024-04-17T15:10:27.860208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'59","last_scrub_stamp":"2024-04-17T15:10:27.860012+0000","last_deep_scrub":"25'59","last_deep_scrub_stamp":"2024-04-17T15:10:27.860012+0000","last_clean_scrub_stamp":"2024-04-17T15:10:27.860012+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:18:57.627575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2802,"num_write":38,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'73","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.187391+0000","last_change":"2024-04-17T15:10:23.187451+0000","last_active":"2024-04-17T15:10:23.187391+0000","last_peered":"2024-04-17T15:10:23.187391+0000","last_clean":"2024-04-17T15:10:23.187391+0000","last_became_active":"2024-04-17T14:39:59.277859+0000","last_became_peered":"2024-04-17T14:39:59.277859+0000","last_unstale":"2024-04-17T15:10:23.187391+0000","last_undegraded":"2024-04-17T15:10:23.187391+0000","last_fullsized":"2024-04-17T15:10:23.187391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-04-17T15:10:23.187199+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-04-17T15:10:23.187199+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.187199+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:38.024786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":55,"num_write_kb":3974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'153","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:33.719950+0000","last_change":"2024-04-17T15:10:33.719974+0000","last_active":"2024-04-17T15:10:33.719950+0000","last_peered":"2024-04-17T15:10:33.719950+0000","last_clean":"2024-04-17T15:10:33.719950+0000","last_became_active":"2024-04-17T14:39:59.421738+0000","last_became_peered":"2024-04-17T14:39:59.421738+0000","last_unstale":"2024-04-17T15:10:33.719950+0000","last_undegraded":"2024-04-17T15:10:33.719950+0000","last_fullsized":"2024-04-17T15:10:33.719950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'153","last_scrub_stamp":"2024-04-17T15:10:33.719856+0000","last_deep_scrub":"25'153","last_deep_scrub_stamp":"2024-04-17T15:10:33.719856+0000","last_clean_scrub_stamp":"2024-04-17T15:10:33.719856+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:46:47.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2286,"num_write":133,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'98","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.953116+0000","last_change":"2024-04-17T15:10:24.953177+0000","last_active":"2024-04-17T15:10:24.953116+0000","last_peered":"2024-04-17T15:10:24.953116+0000","last_clean":"2024-04-17T15:10:24.953116+0000","last_became_active":"2024-04-17T14:39:59.403310+0000","last_became_peered":"2024-04-17T14:39:59.403310+0000","last_unstale":"2024-04-17T15:10:24.953116+0000","last_undegraded":"2024-04-17T15:10:24.953116+0000","last_fullsized":"2024-04-17T15:10:24.953116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'98","last_scrub_stamp":"2024-04-17T15:10:24.952916+0000","last_deep_scrub":"25'98","last_deep_scrub_stamp":"2024-04-17T15:10:24.952916+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.952916+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:27:17.794958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3049,"num_write":71,"num_write_kb":6543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.862123+0000","last_change":"2024-04-17T15:10:22.862143+0000","last_active":"2024-04-17T15:10:22.862123+0000","last_peered":"2024-04-17T15:10:22.862123+0000","last_clean":"2024-04-17T15:10:22.862123+0000","last_became_active":"2024-04-17T14:39:59.420461+0000","last_became_peered":"2024-04-17T14:39:59.420461+0000","last_unstale":"2024-04-17T15:10:22.862123+0000","last_undegraded":"2024-04-17T15:10:22.862123+0000","last_fullsized":"2024-04-17T15:10:22.862123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-04-17T15:10:22.862049+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-04-17T15:10:22.862049+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.862049+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:35:08.304104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":57,"num_write_kb":6003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'76","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.150989+0000","last_change":"2024-04-17T15:10:18.151009+0000","last_active":"2024-04-17T15:10:18.150989+0000","last_peered":"2024-04-17T15:10:18.150989+0000","last_clean":"2024-04-17T15:10:18.150989+0000","last_became_active":"2024-04-17T14:39:59.405200+0000","last_became_peered":"2024-04-17T14:39:59.405200+0000","last_unstale":"2024-04-17T15:10:18.150989+0000","last_undegraded":"2024-04-17T15:10:18.150989+0000","last_fullsized":"2024-04-17T15:10:18.150989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2024-04-17T15:10:18.150927+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2024-04-17T15:10:18.150927+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.150927+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:19:35.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":59,"num_write_kb":5350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'770","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.224654+0000","last_change":"2024-04-17T15:10:20.224702+0000","last_active":"2024-04-17T15:10:20.224654+0000","last_peered":"2024-04-17T15:10:20.224654+0000","last_clean":"2024-04-17T15:10:20.224654+0000","last_became_active":"2024-04-17T14:39:58.265305+0000","last_became_peered":"2024-04-17T14:39:58.265305+0000","last_unstale":"2024-04-17T15:10:20.224654+0000","last_undegraded":"2024-04-17T15:10:20.224654+0000","last_fullsized":"2024-04-17T15:10:20.224654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'770","last_scrub_stamp":"2024-04-17T15:10:20.224511+0000","last_deep_scrub":"25'770","last_deep_scrub_stamp":"2024-04-17T15:10:20.224511+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.224511+0000","objects_scrubbed":1,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:59:42.266479+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'89","reported_seq":137,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:29.565856+0000","last_change":"2024-04-17T15:10:29.565920+0000","last_active":"2024-04-17T15:10:29.565856+0000","last_peered":"2024-04-17T15:10:29.565856+0000","last_clean":"2024-04-17T15:10:29.565856+0000","last_became_active":"2024-04-17T14:39:59.450035+0000","last_became_peered":"2024-04-17T14:39:59.450035+0000","last_unstale":"2024-04-17T15:10:29.565856+0000","last_undegraded":"2024-04-17T15:10:29.565856+0000","last_fullsized":"2024-04-17T15:10:29.565856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-04-17T15:10:29.565630+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-04-17T15:10:29.565630+0000","last_clean_scrub_stamp":"2024-04-17T15:10:29.565630+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:28.573504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":2033,"num_write":68,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'542","reported_seq":583,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:27.675930+0000","last_change":"2024-04-17T15:10:27.675956+0000","last_active":"2024-04-17T15:10:27.675930+0000","last_peered":"2024-04-17T15:10:27.675930+0000","last_clean":"2024-04-17T15:10:27.675930+0000","last_became_active":"2024-04-17T14:39:58.259790+0000","last_became_peered":"2024-04-17T14:39:58.259790+0000","last_unstale":"2024-04-17T15:10:27.675930+0000","last_undegraded":"2024-04-17T15:10:27.675930+0000","last_fullsized":"2024-04-17T15:10:27.675930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'542","last_scrub_stamp":"2024-04-17T15:10:27.675852+0000","last_deep_scrub":"25'542","last_deep_scrub_stamp":"2024-04-17T15:10:27.675852+0000","last_clean_scrub_stamp":"2024-04-17T15:10:27.675852+0000","objects_scrubbed":1,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:59:44.288927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'6","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.890062+0000","last_change":"2024-04-17T15:10:19.890126+0000","last_active":"2024-04-17T15:10:19.890062+0000","last_peered":"2024-04-17T15:10:19.890062+0000","last_clean":"2024-04-17T15:10:19.890062+0000","last_became_active":"2024-04-17T14:39:58.263906+0000","last_became_peered":"2024-04-17T14:39:58.263906+0000","last_unstale":"2024-04-17T15:10:19.890062+0000","last_undegraded":"2024-04-17T15:10:19.890062+0000","last_fullsized":"2024-04-17T15:10:19.890062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-17T15:10:19.889833+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-17T15:10:19.889833+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.889833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:12:22.432548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'97","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:32.222089+0000","last_change":"2024-04-17T15:10:32.222205+0000","last_active":"2024-04-17T15:10:32.222089+0000","last_peered":"2024-04-17T15:10:32.222089+0000","last_clean":"2024-04-17T15:10:32.222089+0000","last_became_active":"2024-04-17T14:39:59.426331+0000","last_became_peered":"2024-04-17T14:39:59.426331+0000","last_unstale":"2024-04-17T15:10:32.222089+0000","last_undegraded":"2024-04-17T15:10:32.222089+0000","last_fullsized":"2024-04-17T15:10:32.222089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'97","last_scrub_stamp":"2024-04-17T15:10:32.221843+0000","last_deep_scrub":"25'97","last_deep_scrub_stamp":"2024-04-17T15:10:32.221843+0000","last_clean_scrub_stamp":"2024-04-17T15:10:32.221843+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:04.352867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1271,"num_write":71,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'2","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.682642+0000","last_change":"2024-04-17T15:10:22.682663+0000","last_active":"2024-04-17T15:10:22.682642+0000","last_peered":"2024-04-17T15:10:22.682642+0000","last_clean":"2024-04-17T15:10:22.682642+0000","last_became_active":"2024-04-17T14:39:58.251764+0000","last_became_peered":"2024-04-17T14:39:58.251764+0000","last_unstale":"2024-04-17T15:10:22.682642+0000","last_undegraded":"2024-04-17T15:10:22.682642+0000","last_fullsized":"2024-04-17T15:10:22.682642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:22.682570+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:22.682570+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.682570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:38:58.824094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'85","reported_seq":140,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.591261+0000","last_change":"2024-04-17T15:10:26.591322+0000","last_active":"2024-04-17T15:10:26.591261+0000","last_peered":"2024-04-17T15:10:26.591261+0000","last_clean":"2024-04-17T15:10:26.591261+0000","last_became_active":"2024-04-17T14:39:59.404131+0000","last_became_peered":"2024-04-17T14:39:59.404131+0000","last_unstale":"2024-04-17T15:10:26.591261+0000","last_undegraded":"2024-04-17T15:10:26.591261+0000","last_fullsized":"2024-04-17T15:10:26.591261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:26.591052+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:26.591052+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.591052+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:32.602153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":63,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.134787+0000","last_change":"2024-04-17T15:10:16.134808+0000","last_active":"2024-04-17T15:10:16.134787+0000","last_peered":"2024-04-17T15:10:16.134787+0000","last_clean":"2024-04-17T15:10:16.134787+0000","last_became_active":"2024-04-17T14:39:58.254301+0000","last_became_peered":"2024-04-17T14:39:58.254301+0000","last_unstale":"2024-04-17T15:10:16.134787+0000","last_undegraded":"2024-04-17T15:10:16.134787+0000","last_fullsized":"2024-04-17T15:10:16.134787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:16.134709+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:16.134709+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.134709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:41:28.548305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'95","reported_seq":140,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.836178+0000","last_change":"2024-04-17T15:10:19.836214+0000","last_active":"2024-04-17T15:10:19.836178+0000","last_peered":"2024-04-17T15:10:19.836178+0000","last_clean":"2024-04-17T15:10:19.836178+0000","last_became_active":"2024-04-17T14:39:59.414252+0000","last_became_peered":"2024-04-17T14:39:59.414252+0000","last_unstale":"2024-04-17T15:10:19.836178+0000","last_undegraded":"2024-04-17T15:10:19.836178+0000","last_fullsized":"2024-04-17T15:10:19.836178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2024-04-17T15:10:19.836101+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2024-04-17T15:10:19.836101+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.836101+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:07:21.115735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1337,"num_write":72,"num_write_kb":6000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'3","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.752061+0000","last_change":"2024-04-17T15:10:17.752083+0000","last_active":"2024-04-17T15:10:17.752061+0000","last_peered":"2024-04-17T15:10:17.752061+0000","last_clean":"2024-04-17T15:10:17.752061+0000","last_became_active":"2024-04-17T14:39:58.257248+0000","last_became_peered":"2024-04-17T14:39:58.257248+0000","last_unstale":"2024-04-17T15:10:17.752061+0000","last_undegraded":"2024-04-17T15:10:17.752061+0000","last_fullsized":"2024-04-17T15:10:17.752061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-17T15:10:17.751988+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-17T15:10:17.751988+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.751988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:09:11.349473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'84","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:30.235274+0000","last_change":"2024-04-17T15:10:30.235338+0000","last_active":"2024-04-17T15:10:30.235274+0000","last_peered":"2024-04-17T15:10:30.235274+0000","last_clean":"2024-04-17T15:10:30.235274+0000","last_became_active":"2024-04-17T14:39:59.416883+0000","last_became_peered":"2024-04-17T14:39:59.416883+0000","last_unstale":"2024-04-17T15:10:30.235274+0000","last_undegraded":"2024-04-17T15:10:30.235274+0000","last_fullsized":"2024-04-17T15:10:30.235274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-04-17T15:10:30.235068+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-04-17T15:10:30.235068+0000","last_clean_scrub_stamp":"2024-04-17T15:10:30.235068+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:05:55.381647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":59,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'395","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.031300+0000","last_change":"2024-04-17T15:10:21.031367+0000","last_active":"2024-04-17T15:10:21.031300+0000","last_peered":"2024-04-17T15:10:21.031300+0000","last_clean":"2024-04-17T15:10:21.031300+0000","last_became_active":"2024-04-17T14:39:58.240126+0000","last_became_peered":"2024-04-17T14:39:58.240126+0000","last_unstale":"2024-04-17T15:10:21.031300+0000","last_undegraded":"2024-04-17T15:10:21.031300+0000","last_fullsized":"2024-04-17T15:10:21.031300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'395","last_scrub_stamp":"2024-04-17T15:10:21.031093+0000","last_deep_scrub":"25'395","last_deep_scrub_stamp":"2024-04-17T15:10:21.031093+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.031093+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:23:58.942577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'84","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.672630+0000","last_change":"2024-04-17T15:10:18.672630+0000","last_active":"2024-04-17T15:10:18.672630+0000","last_peered":"2024-04-17T15:10:18.672630+0000","last_clean":"2024-04-17T15:10:18.672630+0000","last_became_active":"2024-04-17T14:39:59.416332+0000","last_became_peered":"2024-04-17T14:39:59.416332+0000","last_unstale":"2024-04-17T15:10:18.672630+0000","last_undegraded":"2024-04-17T15:10:18.672630+0000","last_fullsized":"2024-04-17T15:10:18.672630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-04-17T15:10:18.672505+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-04-17T15:10:18.672505+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.672505+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:21.696806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":63,"num_write_kb":3236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'928","reported_seq":970,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.868979+0000","last_change":"2024-04-17T15:10:16.868979+0000","last_active":"2024-04-17T15:10:16.868979+0000","last_peered":"2024-04-17T15:10:16.868979+0000","last_clean":"2024-04-17T15:10:16.868979+0000","last_became_active":"2024-04-17T14:39:58.253441+0000","last_became_peered":"2024-04-17T14:39:58.253441+0000","last_unstale":"2024-04-17T15:10:16.868979+0000","last_undegraded":"2024-04-17T15:10:16.868979+0000","last_fullsized":"2024-04-17T15:10:16.868979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'928","last_scrub_stamp":"2024-04-17T15:10:16.868830+0000","last_deep_scrub":"25'928","last_deep_scrub_stamp":"2024-04-17T15:10:16.868830+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.868830+0000","objects_scrubbed":4,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:20:47.991156+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":4530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'85","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.812369+0000","last_change":"2024-04-17T15:10:23.812389+0000","last_active":"2024-04-17T15:10:23.812369+0000","last_peered":"2024-04-17T15:10:23.812369+0000","last_clean":"2024-04-17T15:10:23.812369+0000","last_became_active":"2024-04-17T14:39:59.448315+0000","last_became_peered":"2024-04-17T14:39:59.448315+0000","last_unstale":"2024-04-17T15:10:23.812369+0000","last_undegraded":"2024-04-17T15:10:23.812369+0000","last_fullsized":"2024-04-17T15:10:23.812369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:23.812258+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:23.812258+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.812258+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:52.262399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":66,"num_write_kb":2869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'73","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.969154+0000","last_change":"2024-04-17T15:10:22.969242+0000","last_active":"2024-04-17T15:10:22.969154+0000","last_peered":"2024-04-17T15:10:22.969154+0000","last_clean":"2024-04-17T15:10:22.969154+0000","last_became_active":"2024-04-17T14:39:58.260516+0000","last_became_peered":"2024-04-17T14:39:58.260516+0000","last_unstale":"2024-04-17T15:10:22.969154+0000","last_undegraded":"2024-04-17T15:10:22.969154+0000","last_fullsized":"2024-04-17T15:10:22.969154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-04-17T15:10:22.968938+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-04-17T15:10:22.968938+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.968938+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:33.585677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":693263,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'85","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.868114+0000","last_change":"2024-04-17T15:10:22.868176+0000","last_active":"2024-04-17T15:10:22.868114+0000","last_peered":"2024-04-17T15:10:22.868114+0000","last_clean":"2024-04-17T15:10:22.868114+0000","last_became_active":"2024-04-17T14:39:59.423018+0000","last_became_peered":"2024-04-17T14:39:59.423018+0000","last_unstale":"2024-04-17T15:10:22.868114+0000","last_undegraded":"2024-04-17T15:10:22.868114+0000","last_fullsized":"2024-04-17T15:10:22.868114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:22.867925+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:22.867925+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.867925+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:19.507404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1082,"num_write":62,"num_write_kb":6883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'8","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.704236+0000","last_change":"2024-04-17T15:10:26.704261+0000","last_active":"2024-04-17T15:10:26.704236+0000","last_peered":"2024-04-17T15:10:26.704236+0000","last_clean":"2024-04-17T15:10:26.704236+0000","last_became_active":"2024-04-17T14:39:58.259142+0000","last_became_peered":"2024-04-17T14:39:58.259142+0000","last_unstale":"2024-04-17T15:10:26.704236+0000","last_undegraded":"2024-04-17T15:10:26.704236+0000","last_fullsized":"2024-04-17T15:10:26.704236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-04-17T15:10:26.704162+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-04-17T15:10:26.704162+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.704162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:21.199909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'118","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:37.722334+0000","last_change":"2024-04-17T15:10:37.722358+0000","last_active":"2024-04-17T15:10:37.722334+0000","last_peered":"2024-04-17T15:10:37.722334+0000","last_clean":"2024-04-17T15:10:37.722334+0000","last_became_active":"2024-04-17T14:39:59.446855+0000","last_became_peered":"2024-04-17T14:39:59.446855+0000","last_unstale":"2024-04-17T15:10:37.722334+0000","last_undegraded":"2024-04-17T15:10:37.722334+0000","last_fullsized":"2024-04-17T15:10:37.722334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'118","last_scrub_stamp":"2024-04-17T15:10:37.722233+0000","last_deep_scrub":"25'118","last_deep_scrub_stamp":"2024-04-17T15:10:37.722233+0000","last_clean_scrub_stamp":"2024-04-17T15:10:37.722233+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:49:37.200661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":24487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'2","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:14.742991+0000","last_change":"2024-04-17T15:10:14.742991+0000","last_active":"2024-04-17T15:10:14.742991+0000","last_peered":"2024-04-17T15:10:14.742991+0000","last_clean":"2024-04-17T15:10:14.742991+0000","last_became_active":"2024-04-17T14:39:58.256528+0000","last_became_peered":"2024-04-17T14:39:58.256528+0000","last_unstale":"2024-04-17T15:10:14.742991+0000","last_undegraded":"2024-04-17T15:10:14.742991+0000","last_fullsized":"2024-04-17T15:10:14.742991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:14.742882+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:14.742882+0000","last_clean_scrub_stamp":"2024-04-17T15:10:14.742882+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:41.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'75","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.110245+0000","last_change":"2024-04-17T15:10:17.110245+0000","last_active":"2024-04-17T15:10:17.110245+0000","last_peered":"2024-04-17T15:10:17.110245+0000","last_clean":"2024-04-17T15:10:17.110245+0000","last_became_active":"2024-04-17T14:39:59.405006+0000","last_became_peered":"2024-04-17T14:39:59.405006+0000","last_unstale":"2024-04-17T15:10:17.110245+0000","last_undegraded":"2024-04-17T15:10:17.110245+0000","last_fullsized":"2024-04-17T15:10:17.110245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-04-17T15:10:17.110147+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-04-17T15:10:17.110147+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.110147+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:20:30.836096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":55,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":57,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.601716+0000","last_change":"2024-04-17T15:10:18.601716+0000","last_active":"2024-04-17T15:10:18.601716+0000","last_peered":"2024-04-17T15:10:18.601716+0000","last_clean":"2024-04-17T15:10:18.601716+0000","last_became_active":"2024-04-17T14:39:58.245031+0000","last_became_peered":"2024-04-17T14:39:58.245031+0000","last_unstale":"2024-04-17T15:10:18.601716+0000","last_undegraded":"2024-04-17T15:10:18.601716+0000","last_fullsized":"2024-04-17T15:10:18.601716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-04-17T15:10:18.601402+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-04-17T15:10:18.601402+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.601402+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:29:02.817850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'81","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:17.709325+0000","last_change":"2024-04-17T15:10:17.709325+0000","last_active":"2024-04-17T15:10:17.709325+0000","last_peered":"2024-04-17T15:10:17.709325+0000","last_clean":"2024-04-17T15:10:17.709325+0000","last_became_active":"2024-04-17T14:39:59.416383+0000","last_became_peered":"2024-04-17T14:39:59.416383+0000","last_unstale":"2024-04-17T15:10:17.709325+0000","last_undegraded":"2024-04-17T15:10:17.709325+0000","last_fullsized":"2024-04-17T15:10:17.709325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2024-04-17T15:10:17.709193+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2024-04-17T15:10:17.709193+0000","last_clean_scrub_stamp":"2024-04-17T15:10:17.709193+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:47:07.007544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3310,"num_write":61,"num_write_kb":6412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'6","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.801622+0000","last_change":"2024-04-17T15:10:19.801666+0000","last_active":"2024-04-17T15:10:19.801622+0000","last_peered":"2024-04-17T15:10:19.801622+0000","last_clean":"2024-04-17T15:10:19.801622+0000","last_became_active":"2024-04-17T14:39:58.266501+0000","last_became_peered":"2024-04-17T14:39:58.266501+0000","last_unstale":"2024-04-17T15:10:19.801622+0000","last_undegraded":"2024-04-17T15:10:19.801622+0000","last_fullsized":"2024-04-17T15:10:19.801622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-17T15:10:19.801508+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-17T15:10:19.801508+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.801508+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:22.825808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'45","reported_seq":88,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.877077+0000","last_change":"2024-04-17T15:10:23.877100+0000","last_active":"2024-04-17T15:10:23.877077+0000","last_peered":"2024-04-17T15:10:23.877077+0000","last_clean":"2024-04-17T15:10:23.877077+0000","last_became_active":"2024-04-17T14:39:59.444949+0000","last_became_peered":"2024-04-17T14:39:59.444949+0000","last_unstale":"2024-04-17T15:10:23.877077+0000","last_undegraded":"2024-04-17T15:10:23.877077+0000","last_fullsized":"2024-04-17T15:10:23.877077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'45","last_scrub_stamp":"2024-04-17T15:10:23.876972+0000","last_deep_scrub":"25'45","last_deep_scrub_stamp":"2024-04-17T15:10:23.876972+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.876972+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:23:01.870917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":33,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'4","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.600216+0000","last_change":"2024-04-17T15:10:22.600355+0000","last_active":"2024-04-17T15:10:22.600216+0000","last_peered":"2024-04-17T15:10:22.600216+0000","last_clean":"2024-04-17T15:10:22.600216+0000","last_became_active":"2024-04-17T14:39:58.265579+0000","last_became_peered":"2024-04-17T14:39:58.265579+0000","last_unstale":"2024-04-17T15:10:22.600216+0000","last_undegraded":"2024-04-17T15:10:22.600216+0000","last_fullsized":"2024-04-17T15:10:22.600216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-17T15:10:22.599986+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-17T15:10:22.599986+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.599986+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:14:13.563043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'69","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:29.725265+0000","last_change":"2024-04-17T15:10:29.725288+0000","last_active":"2024-04-17T15:10:29.725265+0000","last_peered":"2024-04-17T15:10:29.725265+0000","last_clean":"2024-04-17T15:10:29.725265+0000","last_became_active":"2024-04-17T14:39:59.451614+0000","last_became_peered":"2024-04-17T14:39:59.451614+0000","last_unstale":"2024-04-17T15:10:29.725265+0000","last_undegraded":"2024-04-17T15:10:29.725265+0000","last_fullsized":"2024-04-17T15:10:29.725265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'69","last_scrub_stamp":"2024-04-17T15:10:29.725200+0000","last_deep_scrub":"25'69","last_deep_scrub_stamp":"2024-04-17T15:10:29.725200+0000","last_clean_scrub_stamp":"2024-04-17T15:10:29.725200+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:49.238673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1016,"num_write":47,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'5","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.200810+0000","last_change":"2024-04-17T15:10:22.200882+0000","last_active":"2024-04-17T15:10:22.200810+0000","last_peered":"2024-04-17T15:10:22.200810+0000","last_clean":"2024-04-17T15:10:22.200810+0000","last_became_active":"2024-04-17T14:39:58.265765+0000","last_became_peered":"2024-04-17T14:39:58.265765+0000","last_unstale":"2024-04-17T15:10:22.200810+0000","last_undegraded":"2024-04-17T15:10:22.200810+0000","last_fullsized":"2024-04-17T15:10:22.200810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-17T15:10:22.200637+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-17T15:10:22.200637+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.200637+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:11.519594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'94","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.775184+0000","last_change":"2024-04-17T15:10:20.775204+0000","last_active":"2024-04-17T15:10:20.775184+0000","last_peered":"2024-04-17T15:10:20.775184+0000","last_clean":"2024-04-17T15:10:20.775184+0000","last_became_active":"2024-04-17T14:39:59.446673+0000","last_became_peered":"2024-04-17T14:39:59.446673+0000","last_unstale":"2024-04-17T15:10:20.775184+0000","last_undegraded":"2024-04-17T15:10:20.775184+0000","last_fullsized":"2024-04-17T15:10:20.775184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'94","last_scrub_stamp":"2024-04-17T15:10:20.775119+0000","last_deep_scrub":"25'94","last_deep_scrub_stamp":"2024-04-17T15:10:20.775119+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.775119+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:56.501520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":1779,"num_write":77,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.876317+0000","last_change":"2024-04-17T15:10:20.876379+0000","last_active":"2024-04-17T15:10:20.876317+0000","last_peered":"2024-04-17T15:10:20.876317+0000","last_clean":"2024-04-17T15:10:20.876317+0000","last_became_active":"2024-04-17T14:39:58.264064+0000","last_became_peered":"2024-04-17T14:39:58.264064+0000","last_unstale":"2024-04-17T15:10:20.876317+0000","last_undegraded":"2024-04-17T15:10:20.876317+0000","last_fullsized":"2024-04-17T15:10:20.876317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-17T15:10:20.876122+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-17T15:10:20.876122+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.876122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:07:22.155756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'87","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:32.678501+0000","last_change":"2024-04-17T15:10:32.678527+0000","last_active":"2024-04-17T15:10:32.678501+0000","last_peered":"2024-04-17T15:10:32.678501+0000","last_clean":"2024-04-17T15:10:32.678501+0000","last_became_active":"2024-04-17T14:39:59.418425+0000","last_became_peered":"2024-04-17T14:39:59.418425+0000","last_unstale":"2024-04-17T15:10:32.678501+0000","last_undegraded":"2024-04-17T15:10:32.678501+0000","last_fullsized":"2024-04-17T15:10:32.678501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-04-17T15:10:32.678401+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-04-17T15:10:32.678401+0000","last_clean_scrub_stamp":"2024-04-17T15:10:32.678401+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:01.586347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":508,"num_write":68,"num_write_kb":2018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:15.147327+0000","last_change":"2024-04-17T15:10:15.147390+0000","last_active":"2024-04-17T15:10:15.147327+0000","last_peered":"2024-04-17T15:10:15.147327+0000","last_clean":"2024-04-17T15:10:15.147327+0000","last_became_active":"2024-04-17T14:39:20.281964+0000","last_became_peered":"2024-04-17T14:39:20.281964+0000","last_unstale":"2024-04-17T15:10:15.147327+0000","last_undegraded":"2024-04-17T15:10:15.147327+0000","last_fullsized":"2024-04-17T15:10:15.147327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-04-17T15:10:15.147208+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-04-17T15:10:15.147208+0000","last_clean_scrub_stamp":"2024-04-17T15:10:15.147208+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:25:55.619039+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'7","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.769453+0000","last_change":"2024-04-17T15:10:24.769474+0000","last_active":"2024-04-17T15:10:24.769453+0000","last_peered":"2024-04-17T15:10:24.769453+0000","last_clean":"2024-04-17T15:10:24.769453+0000","last_became_active":"2024-04-17T14:39:58.257972+0000","last_became_peered":"2024-04-17T14:39:58.257972+0000","last_unstale":"2024-04-17T15:10:24.769453+0000","last_undegraded":"2024-04-17T15:10:24.769453+0000","last_fullsized":"2024-04-17T15:10:24.769453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-04-17T15:10:24.769366+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-04-17T15:10:24.769366+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.769366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:44.660322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'90","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.612675+0000","last_change":"2024-04-17T15:10:25.612874+0000","last_active":"2024-04-17T15:10:25.612675+0000","last_peered":"2024-04-17T15:10:25.612675+0000","last_clean":"2024-04-17T15:10:25.612675+0000","last_became_active":"2024-04-17T14:39:59.403629+0000","last_became_peered":"2024-04-17T14:39:59.403629+0000","last_unstale":"2024-04-17T15:10:25.612675+0000","last_undegraded":"2024-04-17T15:10:25.612675+0000","last_fullsized":"2024-04-17T15:10:25.612675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2024-04-17T15:10:25.612435+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2024-04-17T15:10:25.612435+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.612435+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:13.205729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2040,"num_write":75,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'212","reported_seq":256,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.723969+0000","last_change":"2024-04-17T15:10:21.723994+0000","last_active":"2024-04-17T15:10:21.723969+0000","last_peered":"2024-04-17T15:10:21.723969+0000","last_clean":"2024-04-17T15:10:21.723969+0000","last_became_active":"2024-04-17T14:39:58.261799+0000","last_became_peered":"2024-04-17T14:39:58.261799+0000","last_unstale":"2024-04-17T15:10:21.723969+0000","last_undegraded":"2024-04-17T15:10:21.723969+0000","last_fullsized":"2024-04-17T15:10:21.723969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'212","last_scrub_stamp":"2024-04-17T15:10:21.723895+0000","last_deep_scrub":"25'212","last_deep_scrub_stamp":"2024-04-17T15:10:21.723895+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.723895+0000","objects_scrubbed":1,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:26:05.957587+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'85","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.824048+0000","last_change":"2024-04-17T15:10:23.824110+0000","last_active":"2024-04-17T15:10:23.824048+0000","last_peered":"2024-04-17T15:10:23.824048+0000","last_clean":"2024-04-17T15:10:23.824048+0000","last_became_active":"2024-04-17T14:39:59.423764+0000","last_became_peered":"2024-04-17T14:39:59.423764+0000","last_unstale":"2024-04-17T15:10:23.824048+0000","last_undegraded":"2024-04-17T15:10:23.824048+0000","last_fullsized":"2024-04-17T15:10:23.824048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:23.823850+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:23.823850+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.823850+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:44:48.958120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":73,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'624","reported_seq":1285,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:22.007020+0000","last_change":"2024-04-17T15:10:22.007199+0000","last_active":"2024-04-17T15:10:22.007020+0000","last_peered":"2024-04-17T15:10:22.007020+0000","last_clean":"2024-04-17T15:10:22.007020+0000","last_became_active":"2024-04-17T14:39:58.258206+0000","last_became_peered":"2024-04-17T14:39:58.258206+0000","last_unstale":"2024-04-17T15:10:22.007020+0000","last_undegraded":"2024-04-17T15:10:22.007020+0000","last_fullsized":"2024-04-17T15:10:22.007020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'624","last_scrub_stamp":"2024-04-17T15:10:22.006795+0000","last_deep_scrub":"25'624","last_deep_scrub_stamp":"2024-04-17T15:10:22.006795+0000","last_clean_scrub_stamp":"2024-04-17T15:10:22.006795+0000","objects_scrubbed":1,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:14:12.483554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245531,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":618,"num_read_kb":708,"num_write":620,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.156613+0000","last_change":"2024-04-17T15:10:24.156674+0000","last_active":"2024-04-17T15:10:24.156613+0000","last_peered":"2024-04-17T15:10:24.156613+0000","last_clean":"2024-04-17T15:10:24.156613+0000","last_became_active":"2024-04-17T14:39:59.278037+0000","last_became_peered":"2024-04-17T14:39:59.278037+0000","last_unstale":"2024-04-17T15:10:24.156613+0000","last_undegraded":"2024-04-17T15:10:24.156613+0000","last_fullsized":"2024-04-17T15:10:24.156613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-04-17T15:10:24.156395+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-04-17T15:10:24.156395+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.156395+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:48.296021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":53,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.722157+0000","last_change":"2024-04-17T15:10:25.722178+0000","last_active":"2024-04-17T15:10:25.722157+0000","last_peered":"2024-04-17T15:10:25.722157+0000","last_clean":"2024-04-17T15:10:25.722157+0000","last_became_active":"2024-04-17T14:39:58.259126+0000","last_became_peered":"2024-04-17T14:39:58.259126+0000","last_unstale":"2024-04-17T15:10:25.722157+0000","last_undegraded":"2024-04-17T15:10:25.722157+0000","last_fullsized":"2024-04-17T15:10:25.722157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-17T15:10:25.722078+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-17T15:10:25.722078+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.722078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:53.320628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'64","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.868955+0000","last_change":"2024-04-17T15:10:26.869079+0000","last_active":"2024-04-17T15:10:26.868955+0000","last_peered":"2024-04-17T15:10:26.868955+0000","last_clean":"2024-04-17T15:10:26.868955+0000","last_became_active":"2024-04-17T14:40:10.456422+0000","last_became_peered":"2024-04-17T14:40:10.456422+0000","last_unstale":"2024-04-17T15:10:26.868955+0000","last_undegraded":"2024-04-17T15:10:26.868955+0000","last_fullsized":"2024-04-17T15:10:26.868955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-04-17T15:10:26.868717+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-04-17T15:10:26.868717+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.868717+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:17:48.070887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":762,"num_write":47,"num_write_kb":3555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"25'4","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.221864+0000","last_change":"2024-04-17T15:10:21.221922+0000","last_active":"2024-04-17T15:10:21.221864+0000","last_peered":"2024-04-17T15:10:21.221864+0000","last_clean":"2024-04-17T15:10:21.221864+0000","last_became_active":"2024-04-17T14:39:58.265644+0000","last_became_peered":"2024-04-17T14:39:58.265644+0000","last_unstale":"2024-04-17T15:10:21.221864+0000","last_undegraded":"2024-04-17T15:10:21.221864+0000","last_fullsized":"2024-04-17T15:10:21.221864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-17T15:10:21.221651+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-17T15:10:21.221651+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.221651+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:53.263844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'80","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.830948+0000","last_change":"2024-04-17T15:10:21.830995+0000","last_active":"2024-04-17T15:10:21.830948+0000","last_peered":"2024-04-17T15:10:21.830948+0000","last_clean":"2024-04-17T15:10:21.830948+0000","last_became_active":"2024-04-17T14:39:59.420085+0000","last_became_peered":"2024-04-17T14:39:59.420085+0000","last_unstale":"2024-04-17T15:10:21.830948+0000","last_undegraded":"2024-04-17T15:10:21.830948+0000","last_fullsized":"2024-04-17T15:10:21.830948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'80","last_scrub_stamp":"2024-04-17T15:10:21.830869+0000","last_deep_scrub":"25'80","last_deep_scrub_stamp":"2024-04-17T15:10:21.830869+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.830869+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:29:06.047317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3048,"num_write":66,"num_write_kb":3750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:28.665899+0000","last_change":"2024-04-17T15:10:28.665920+0000","last_active":"2024-04-17T15:10:28.665899+0000","last_peered":"2024-04-17T15:10:28.665899+0000","last_clean":"2024-04-17T15:10:28.665899+0000","last_became_active":"2024-04-17T14:39:58.260222+0000","last_became_peered":"2024-04-17T14:39:58.260222+0000","last_unstale":"2024-04-17T15:10:28.665899+0000","last_undegraded":"2024-04-17T15:10:28.665899+0000","last_fullsized":"2024-04-17T15:10:28.665899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:28.665823+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:28.665823+0000","last_clean_scrub_stamp":"2024-04-17T15:10:28.665823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:48.179295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'85","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.877644+0000","last_change":"2024-04-17T15:10:26.877703+0000","last_active":"2024-04-17T15:10:26.877644+0000","last_peered":"2024-04-17T15:10:26.877644+0000","last_clean":"2024-04-17T15:10:26.877644+0000","last_became_active":"2024-04-17T14:39:59.431825+0000","last_became_peered":"2024-04-17T14:39:59.431825+0000","last_unstale":"2024-04-17T15:10:26.877644+0000","last_undegraded":"2024-04-17T15:10:26.877644+0000","last_fullsized":"2024-04-17T15:10:26.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-04-17T15:10:26.877434+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-04-17T15:10:26.877434+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.877434+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:14:17.840491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":61,"num_write_kb":2647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'1176","reported_seq":1219,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.578417+0000","last_change":"2024-04-17T15:10:21.578486+0000","last_active":"2024-04-17T15:10:21.578417+0000","last_peered":"2024-04-17T15:10:21.578417+0000","last_clean":"2024-04-17T15:10:21.578417+0000","last_became_active":"2024-04-17T14:39:58.264433+0000","last_became_peered":"2024-04-17T14:39:58.264433+0000","last_unstale":"2024-04-17T15:10:21.578417+0000","last_undegraded":"2024-04-17T15:10:21.578417+0000","last_fullsized":"2024-04-17T15:10:21.578417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1176","last_scrub_stamp":"2024-04-17T15:10:21.578212+0000","last_deep_scrub":"25'1176","last_deep_scrub_stamp":"2024-04-17T15:10:21.578212+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.578212+0000","objects_scrubbed":1,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:52:48.475429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2896,"num_write_kb":1176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'90","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:28.577934+0000","last_change":"2024-04-17T15:10:28.578059+0000","last_active":"2024-04-17T15:10:28.577934+0000","last_peered":"2024-04-17T15:10:28.577934+0000","last_clean":"2024-04-17T15:10:28.577934+0000","last_became_active":"2024-04-17T14:39:59.427168+0000","last_became_peered":"2024-04-17T14:39:59.427168+0000","last_unstale":"2024-04-17T15:10:28.577934+0000","last_undegraded":"2024-04-17T15:10:28.577934+0000","last_fullsized":"2024-04-17T15:10:28.577934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'90","last_scrub_stamp":"2024-04-17T15:10:28.577566+0000","last_deep_scrub":"25'90","last_deep_scrub_stamp":"2024-04-17T15:10:28.577566+0000","last_clean_scrub_stamp":"2024-04-17T15:10:28.577566+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:54:15.253351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3434,"num_write":74,"num_write_kb":5406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'10","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:29.696686+0000","last_change":"2024-04-17T15:10:29.696708+0000","last_active":"2024-04-17T15:10:29.696686+0000","last_peered":"2024-04-17T15:10:29.696686+0000","last_clean":"2024-04-17T15:10:29.696686+0000","last_became_active":"2024-04-17T14:39:58.261629+0000","last_became_peered":"2024-04-17T14:39:58.261629+0000","last_unstale":"2024-04-17T15:10:29.696686+0000","last_undegraded":"2024-04-17T15:10:29.696686+0000","last_fullsized":"2024-04-17T15:10:29.696686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-04-17T15:10:29.696610+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-04-17T15:10:29.696610+0000","last_clean_scrub_stamp":"2024-04-17T15:10:29.696610+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:04.496100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'76","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:24.607330+0000","last_change":"2024-04-17T15:10:24.607451+0000","last_active":"2024-04-17T15:10:24.607330+0000","last_peered":"2024-04-17T15:10:24.607330+0000","last_clean":"2024-04-17T15:10:24.607330+0000","last_became_active":"2024-04-17T14:39:59.276477+0000","last_became_peered":"2024-04-17T14:39:59.276477+0000","last_unstale":"2024-04-17T15:10:24.607330+0000","last_undegraded":"2024-04-17T15:10:24.607330+0000","last_fullsized":"2024-04-17T15:10:24.607330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'76","last_scrub_stamp":"2024-04-17T15:10:24.607118+0000","last_deep_scrub":"25'76","last_deep_scrub_stamp":"2024-04-17T15:10:24.607118+0000","last_clean_scrub_stamp":"2024-04-17T15:10:24.607118+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:52.200495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1524,"num_write":52,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:15.765229+0000","last_change":"2024-04-17T15:10:15.765229+0000","last_active":"2024-04-17T15:10:15.765229+0000","last_peered":"2024-04-17T15:10:15.765229+0000","last_clean":"2024-04-17T15:10:15.765229+0000","last_became_active":"2024-04-17T14:39:58.257208+0000","last_became_peered":"2024-04-17T14:39:58.257208+0000","last_unstale":"2024-04-17T15:10:15.765229+0000","last_undegraded":"2024-04-17T15:10:15.765229+0000","last_fullsized":"2024-04-17T15:10:15.765229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-17T15:10:15.765096+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-17T15:10:15.765096+0000","last_clean_scrub_stamp":"2024-04-17T15:10:15.765096+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:14:06.728153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'99","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:30.654908+0000","last_change":"2024-04-17T15:10:30.654934+0000","last_active":"2024-04-17T15:10:30.654908+0000","last_peered":"2024-04-17T15:10:30.654908+0000","last_clean":"2024-04-17T15:10:30.654908+0000","last_became_active":"2024-04-17T14:39:59.417053+0000","last_became_peered":"2024-04-17T14:39:59.417053+0000","last_unstale":"2024-04-17T15:10:30.654908+0000","last_undegraded":"2024-04-17T15:10:30.654908+0000","last_fullsized":"2024-04-17T15:10:30.654908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'99","last_scrub_stamp":"2024-04-17T15:10:30.654822+0000","last_deep_scrub":"25'99","last_deep_scrub_stamp":"2024-04-17T15:10:30.654822+0000","last_clean_scrub_stamp":"2024-04-17T15:10:30.654822+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:03:41.982635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2098,"num_write":85,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'6","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.580261+0000","last_change":"2024-04-17T15:10:20.580327+0000","last_active":"2024-04-17T15:10:20.580261+0000","last_peered":"2024-04-17T15:10:20.580261+0000","last_clean":"2024-04-17T15:10:20.580261+0000","last_became_active":"2024-04-17T14:39:58.260814+0000","last_became_peered":"2024-04-17T14:39:58.260814+0000","last_unstale":"2024-04-17T15:10:20.580261+0000","last_undegraded":"2024-04-17T15:10:20.580261+0000","last_fullsized":"2024-04-17T15:10:20.580261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-17T15:10:20.580062+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-17T15:10:20.580062+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.580062+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:22:58.574006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.640279+0000","last_change":"2024-04-17T15:10:23.640347+0000","last_active":"2024-04-17T15:10:23.640279+0000","last_peered":"2024-04-17T15:10:23.640279+0000","last_clean":"2024-04-17T15:10:23.640279+0000","last_became_active":"2024-04-17T14:39:59.276596+0000","last_became_peered":"2024-04-17T14:39:59.276596+0000","last_unstale":"2024-04-17T15:10:23.640279+0000","last_undegraded":"2024-04-17T15:10:23.640279+0000","last_fullsized":"2024-04-17T15:10:23.640279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2024-04-17T15:10:23.640000+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2024-04-17T15:10:23.640000+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.640000+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:18:53.407563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":50,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'2","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:21.905756+0000","last_change":"2024-04-17T15:10:21.905756+0000","last_active":"2024-04-17T15:10:21.905756+0000","last_peered":"2024-04-17T15:10:21.905756+0000","last_clean":"2024-04-17T15:10:21.905756+0000","last_became_active":"2024-04-17T14:39:58.269744+0000","last_became_peered":"2024-04-17T14:39:58.269744+0000","last_unstale":"2024-04-17T15:10:21.905756+0000","last_undegraded":"2024-04-17T15:10:21.905756+0000","last_fullsized":"2024-04-17T15:10:21.905756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-17T15:10:21.905343+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-17T15:10:21.905343+0000","last_clean_scrub_stamp":"2024-04-17T15:10:21.905343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:25:15.131730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'83","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:25.905189+0000","last_change":"2024-04-17T15:10:25.905253+0000","last_active":"2024-04-17T15:10:25.905189+0000","last_peered":"2024-04-17T15:10:25.905189+0000","last_clean":"2024-04-17T15:10:25.905189+0000","last_became_active":"2024-04-17T14:39:59.422726+0000","last_became_peered":"2024-04-17T14:39:59.422726+0000","last_unstale":"2024-04-17T15:10:25.905189+0000","last_undegraded":"2024-04-17T15:10:25.905189+0000","last_fullsized":"2024-04-17T15:10:25.905189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'83","last_scrub_stamp":"2024-04-17T15:10:25.905005+0000","last_deep_scrub":"25'83","last_deep_scrub_stamp":"2024-04-17T15:10:25.905005+0000","last_clean_scrub_stamp":"2024-04-17T15:10:25.905005+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:15:44.452221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":5334,"num_write":67,"num_write_kb":4068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'780","reported_seq":822,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:23.735315+0000","last_change":"2024-04-17T15:10:23.735344+0000","last_active":"2024-04-17T15:10:23.735315+0000","last_peered":"2024-04-17T15:10:23.735315+0000","last_clean":"2024-04-17T15:10:23.735315+0000","last_became_active":"2024-04-17T14:39:58.253958+0000","last_became_peered":"2024-04-17T14:39:58.253958+0000","last_unstale":"2024-04-17T15:10:23.735315+0000","last_undegraded":"2024-04-17T15:10:23.735315+0000","last_fullsized":"2024-04-17T15:10:23.735315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'780","last_scrub_stamp":"2024-04-17T15:10:23.735231+0000","last_deep_scrub":"25'780","last_deep_scrub_stamp":"2024-04-17T15:10:23.735231+0000","last_clean_scrub_stamp":"2024-04-17T15:10:23.735231+0000","objects_scrubbed":2,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:44:12.608991+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'124","reported_seq":174,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.681239+0000","last_change":"2024-04-17T15:10:20.681239+0000","last_active":"2024-04-17T15:10:20.681239+0000","last_peered":"2024-04-17T15:10:20.681239+0000","last_clean":"2024-04-17T15:10:20.681239+0000","last_became_active":"2024-04-17T14:39:59.417230+0000","last_became_peered":"2024-04-17T14:39:59.417230+0000","last_unstale":"2024-04-17T15:10:20.681239+0000","last_undegraded":"2024-04-17T15:10:20.681239+0000","last_fullsized":"2024-04-17T15:10:20.681239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'124","last_scrub_stamp":"2024-04-17T15:10:20.681117+0000","last_deep_scrub":"25'124","last_deep_scrub_stamp":"2024-04-17T15:10:20.681117+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.681117+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:33.009760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3056,"num_write":110,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'91","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:35.705688+0000","last_change":"2024-04-17T15:10:35.705714+0000","last_active":"2024-04-17T15:10:35.705688+0000","last_peered":"2024-04-17T15:10:35.705688+0000","last_clean":"2024-04-17T15:10:35.705688+0000","last_became_active":"2024-04-17T14:39:59.445663+0000","last_became_peered":"2024-04-17T14:39:59.445663+0000","last_unstale":"2024-04-17T15:10:35.705688+0000","last_undegraded":"2024-04-17T15:10:35.705688+0000","last_fullsized":"2024-04-17T15:10:35.705688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'91","last_scrub_stamp":"2024-04-17T15:10:35.705588+0000","last_deep_scrub":"25'91","last_deep_scrub_stamp":"2024-04-17T15:10:35.705588+0000","last_clean_scrub_stamp":"2024-04-17T15:10:35.705588+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:48:32.717578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2294,"num_write":58,"num_write_kb":5884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'6","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:18.765958+0000","last_change":"2024-04-17T15:10:18.765980+0000","last_active":"2024-04-17T15:10:18.765958+0000","last_peered":"2024-04-17T15:10:18.765958+0000","last_clean":"2024-04-17T15:10:18.765958+0000","last_became_active":"2024-04-17T14:39:58.257772+0000","last_became_peered":"2024-04-17T14:39:58.257772+0000","last_unstale":"2024-04-17T15:10:18.765958+0000","last_undegraded":"2024-04-17T15:10:18.765958+0000","last_fullsized":"2024-04-17T15:10:18.765958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-17T15:10:18.765888+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-17T15:10:18.765888+0000","last_clean_scrub_stamp":"2024-04-17T15:10:18.765888+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:47:08.064239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'71","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:20.120667+0000","last_change":"2024-04-17T15:10:20.120690+0000","last_active":"2024-04-17T15:10:20.120667+0000","last_peered":"2024-04-17T15:10:20.120667+0000","last_clean":"2024-04-17T15:10:20.120667+0000","last_became_active":"2024-04-17T14:39:59.448813+0000","last_became_peered":"2024-04-17T14:39:59.448813+0000","last_unstale":"2024-04-17T15:10:20.120667+0000","last_undegraded":"2024-04-17T15:10:20.120667+0000","last_fullsized":"2024-04-17T15:10:20.120667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-04-17T15:10:20.120601+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-04-17T15:10:20.120601+0000","last_clean_scrub_stamp":"2024-04-17T15:10:20.120601+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:52.025650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":254,"num_write":47,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1269","reported_seq":1310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:16.794959+0000","last_change":"2024-04-17T15:10:16.795043+0000","last_active":"2024-04-17T15:10:16.794959+0000","last_peered":"2024-04-17T15:10:16.794959+0000","last_clean":"2024-04-17T15:10:16.794959+0000","last_became_active":"2024-04-17T14:39:58.257281+0000","last_became_peered":"2024-04-17T14:39:58.257281+0000","last_unstale":"2024-04-17T15:10:16.794959+0000","last_undegraded":"2024-04-17T15:10:16.794959+0000","last_fullsized":"2024-04-17T15:10:16.794959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1269","last_scrub_stamp":"2024-04-17T15:10:16.794873+0000","last_deep_scrub":"25'1269","last_deep_scrub_stamp":"2024-04-17T15:10:16.794873+0000","last_clean_scrub_stamp":"2024-04-17T15:10:16.794873+0000","objects_scrubbed":3,"log_size":1269,"log_dups_size":0,"ondisk_log_size":1269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:23.916337+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":8829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'122","reported_seq":182,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:28.181180+0000","last_change":"2024-04-17T15:10:28.181243+0000","last_active":"2024-04-17T15:10:28.181180+0000","last_peered":"2024-04-17T15:10:28.181180+0000","last_clean":"2024-04-17T15:10:28.181180+0000","last_became_active":"2024-04-17T14:39:59.405696+0000","last_became_peered":"2024-04-17T14:39:59.405696+0000","last_unstale":"2024-04-17T15:10:28.181180+0000","last_undegraded":"2024-04-17T15:10:28.181180+0000","last_fullsized":"2024-04-17T15:10:28.181180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'122","last_scrub_stamp":"2024-04-17T15:10:28.180975+0000","last_deep_scrub":"25'122","last_deep_scrub_stamp":"2024-04-17T15:10:28.180975+0000","last_clean_scrub_stamp":"2024-04-17T15:10:28.180975+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:16:07.300840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":4826,"num_write":107,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"25'780","reported_seq":824,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.206981+0000","last_change":"2024-04-17T15:10:19.207045+0000","last_active":"2024-04-17T15:10:19.206981+0000","last_peered":"2024-04-17T15:10:19.206981+0000","last_clean":"2024-04-17T15:10:19.206981+0000","last_became_active":"2024-04-17T14:39:58.263761+0000","last_became_peered":"2024-04-17T14:39:58.263761+0000","last_unstale":"2024-04-17T15:10:19.206981+0000","last_undegraded":"2024-04-17T15:10:19.206981+0000","last_fullsized":"2024-04-17T15:10:19.206981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'780","last_scrub_stamp":"2024-04-17T15:10:19.206797+0000","last_deep_scrub":"25'780","last_deep_scrub_stamp":"2024-04-17T15:10:19.206797+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.206797+0000","objects_scrubbed":1,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:09:20.179650+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'95","reported_seq":153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:26.131371+0000","last_change":"2024-04-17T15:10:26.131438+0000","last_active":"2024-04-17T15:10:26.131371+0000","last_peered":"2024-04-17T15:10:26.131371+0000","last_clean":"2024-04-17T15:10:26.131371+0000","last_became_active":"2024-04-17T14:39:59.404016+0000","last_became_peered":"2024-04-17T14:39:59.404016+0000","last_unstale":"2024-04-17T15:10:26.131371+0000","last_undegraded":"2024-04-17T15:10:26.131371+0000","last_fullsized":"2024-04-17T15:10:26.131371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'95","last_scrub_stamp":"2024-04-17T15:10:26.131165+0000","last_deep_scrub":"25'95","last_deep_scrub_stamp":"2024-04-17T15:10:26.131165+0000","last_clean_scrub_stamp":"2024-04-17T15:10:26.131165+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:17:35.581644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4064,"num_write":83,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'710","reported_seq":753,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-17T15:10:19.628324+0000","last_change":"2024-04-17T15:10:19.628407+0000","last_active":"2024-04-17T15:10:19.628324+0000","last_peered":"2024-04-17T15:10:19.628324+0000","last_clean":"2024-04-17T15:10:19.628324+0000","last_became_active":"2024-04-17T14:39:58.258069+0000","last_became_peered":"2024-04-17T14:39:58.258069+0000","last_unstale":"2024-04-17T15:10:19.628324+0000","last_undegraded":"2024-04-17T15:10:19.628324+0000","last_fullsized":"2024-04-17T15:10:19.628324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'710","last_scrub_stamp":"2024-04-17T15:10:19.628106+0000","last_deep_scrub":"25'710","last_deep_scrub_stamp":"2024-04-17T15:10:19.628106+0000","last_clean_scrub_stamp":"2024-04-17T15:10:19.628106+0000","objects_scrubbed":3,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:35:05.070162+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":705,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":526,"num_read_kb":137179,"num_write":4261,"num_write_kb":326145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5536,"ondisk_log_size":5536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38688966,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":618,"num_read_kb":708,"num_write":9934,"num_write_kb":42607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77438976,"data_stored":77377932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8362,"ondisk_log_size":8362,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509821,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":4348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":4452352,"data_stored":4288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509821,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":8460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":8663040,"data_stored":8484412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509822,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43656,"kb_used_data":16640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94328184,"statfs":{"total":96636764160,"available":96592060416,"internally_reserved":0,"allocated":17039360,"data_stored":16872258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35468,"kb_used_data":8452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336372,"statfs":{"total":96636764160,"available":96600444928,"internally_reserved":0,"allocated":8654848,"data_stored":8483740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509821,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48524,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323316,"statfs":{"total":96636764160,"available":96587075584,"internally_reserved":0,"allocated":9244672,"data_stored":9073506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509821,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44404,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327436,"statfs":{"total":96636764160,"available":96591294464,"internally_reserved":0,"allocated":13545472,"data_stored":13370657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542524,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":5276,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":5402624,"data_stored":5227648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542525,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58432,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313408,"statfs":{"total":96636764160,"available":96576929792,"internally_reserved":0,"allocated":13688832,"data_stored":13513363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13287424,"data_stored":13276197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12836864,"data_stored":12828535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5144576,"data_stored":5133188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:10:42.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T15:10:42.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.231+0000 7f2184c00640 1 Processor -- start 2024-04-17T15:10:42.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f2184c00640 1 -- start start 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f2184c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f218015be40 0x7f21800c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f2184c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180158610 con 0x7f21800c5a20 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f2184c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21801588f0 con 0x7f2180151db0 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f2184c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f21800c8be0 con 0x7f218015be40 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f217e800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f21800c5a20 0x7f21800c3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44802/0 (socket says 172.21.15.16:44802) 2024-04-17T15:10:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.235+0000 7f217e800640 1 -- 172.21.15.16:0/1837022879 learned_addr learned my addr 172.21.15.16:0/1837022879 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:42.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.239+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119865437 0 0) 0x7f2180158610 con 0x7f21800c5a20 2024-04-17T15:10:42.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.239+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2164003530 con 0x7f21800c5a20 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1010546712 0 0) 0x7f2164003530 con 0x7f21800c5a20 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 >> v2:172.21.15.67:3300/0 conn(0x7f218015be40 msgr2=0x7f21800c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 --2- 172.21.15.16:0/1837022879 >> v2:172.21.15.67:3300/0 conn(0x7f218015be40 0x7f21800c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 >> v1:172.21.15.67:6789/0 conn(0x7f2180151db0 legacy=0x7f2180157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218015b360 con 0x7f21800c5a20 2024-04-17T15:10:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f2178001a00 con 0x7f21800c5a20 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 >> v1:172.21.15.16:6789/0 conn(0x7f21800c5a20 legacy=0x7f21800c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 0x7f2164003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164004810 0x7f2164004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21640052f0 0x7f216400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f216400c200 con 0x7f2164003a10 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f216400c3b0 con 0x7f21640052f0 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f216400c5b0 con 0x7f2164004810 2024-04-17T15:10:42.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217e800640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21640052f0 0x7f216400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.243+0000 7f217de00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 0x7f2164003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217de00640 1 -- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164004810 msgr2=0x7f2164004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217de00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164004810 0x7f2164004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217de00640 1 -- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21640052f0 msgr2=0x7f216400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217de00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21640052f0 0x7f216400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217de00640 1 -- 172.21.15.16:0/1837022879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164003530 con 0x7f2164003a10 2024-04-17T15:10:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.247+0000 7f217e800640 1 -- 172.21.15.16:0/1837022879 reap_dead start 2024-04-17T15:10:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.251+0000 7f217de00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 0x7f2164003e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2170007fd0 tx=0x7f217001c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae95ac370e955a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:42.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170001250 con 0x7f2164003a10 2024-04-17T15:10:42.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2170005270 con 0x7f2164003a10 2024-04-17T15:10:42.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f217ca00640 1 -- 172.21.15.16:0/1837022879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21700054a0 con 0x7f2164003a10 2024-04-17T15:10:42.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 -- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 msgr2=0x7f2164003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 0x7f2164003e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2170007fd0 tx=0x7f217001c2c0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 -- 172.21.15.16:0/1837022879 shutdown_connections 2024-04-17T15:10:42.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 --2- 172.21.15.16:0/1837022879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2164003a10 0x7f2164003e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 -- 172.21.15.16:0/1837022879 >> 172.21.15.16:0/1837022879 conn(0x7f218006ba30 msgr2=0x7f218006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:42.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 -- 172.21.15.16:0/1837022879 shutdown_connections 2024-04-17T15:10:42.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.255+0000 7f2184c00640 1 -- 172.21.15.16:0/1837022879 wait complete. 2024-04-17T15:10:42.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 Processor -- start 2024-04-17T15:10:42.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 -- start start 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164003a10 0x7f21801f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f218014dcd0 0x7f21801597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f218015b920 con 0x7f2180150670 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2180071b30 con 0x7f218014dcd0 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f2184c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f2180152190 con 0x7f2164003a10 2024-04-17T15:10:42.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f217e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f217e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54508/0 (socket says 172.21.15.16:54508) 2024-04-17T15:10:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f217e800640 1 -- 172.21.15.16:0/3362947881 learned_addr learned my addr 172.21.15.16:0/3362947881 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.259+0000 7f217d400640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f218014dcd0 0x7f21801597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217de00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164003a10 0x7f21801f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217e800640 1 -- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164003a10 msgr2=0x7f21801f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217e800640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164003a10 0x7f21801f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217e800640 1 -- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f218014dcd0 msgr2=0x7f21801597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217e800640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f218014dcd0 0x7f21801597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.263+0000 7f217e800640 1 -- 172.21.15.16:0/3362947881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21801f4aa0 con 0x7f2180150670 2024-04-17T15:10:42.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.267+0000 7f217e800640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2180155800 tx=0x7f21780079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:42.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217801c070 con 0x7f2180150670 2024-04-17T15:10:42.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217800ae10 con 0x7f2180150670 2024-04-17T15:10:42.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178010040 con 0x7f2180150670 2024-04-17T15:10:42.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218014d630 con 0x7f2180150670 2024-04-17T15:10:42.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21800730b0 con 0x7f2180150670 2024-04-17T15:10:42.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.271+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21801f0c20 con 0x7f2180150670 2024-04-17T15:10:42.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.291+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f217801f070 con 0x7f2180150670 2024-04-17T15:10:42.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.291+0000 7f2176000640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 0x7f216006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:42.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.291+0000 7f217de00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 0x7f216006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:42.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.295+0000 7f217de00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 0x7f216006a8c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f21700aa000 tx=0x7f2170001030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:42.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.583+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2178057460 con 0x7f2180150670 2024-04-17T15:10:42.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.583+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2178026080 con 0x7f2180150670 2024-04-17T15:10:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.751+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f2180076280 con 0x7f2180150670 2024-04-17T15:10:42.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f21780593c0 con 0x7f2180150670 2024-04-17T15:10:42.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2176000640 1 -- 172.21.15.16:0/3362947881 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f217805d6c0 con 0x7f2180150670 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 msgr2=0x7f216006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 0x7f216006a8c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f21700aa000 tx=0x7f2170001030 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 msgr2=0x7f2180150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2180155800 tx=0x7f21780079b0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 shutdown_connections 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f2160068400 0x7f216006a8c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2180150670 0x7f2180150b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f218014dcd0 0x7f21801597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 --2- 172.21.15.16:0/3362947881 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2164003a10 0x7f21801f10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 >> 172.21.15.16:0/3362947881 conn(0x7f218006ba30 msgr2=0x7f21800c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 shutdown_connections 2024-04-17T15:10:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:42.859+0000 7f2184c00640 1 -- 172.21.15.16:0/3362947881 wait complete. 2024-04-17T15:10:42.883 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T15:10:42.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T15:10:43.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 Processor -- start 2024-04-17T15:10:43.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 -- start start 2024-04-17T15:10:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3e41550e0 0x7ff3e415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff3e40731d0 0x7ff3e406f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e40c8d30 con 0x7ff3e4154d00 2024-04-17T15:10:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e415bbf0 con 0x7ff3e41550e0 2024-04-17T15:10:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.023+0000 7ff3e9200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e40c9010 con 0x7ff3e40731d0 2024-04-17T15:10:43.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3e41550e0 0x7ff3e415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3e41550e0 0x7ff3e415b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54524/0 (socket says 172.21.15.16:54524) 2024-04-17T15:10:43.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 -- 172.21.15.16:0/1060672961 learned_addr learned my addr 172.21.15.16:0/1060672961 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 -- 172.21.15.16:0/1060672961 >> v2:172.21.15.67:3300/0 conn(0x7ff3e40731d0 msgr2=0x7ff3e406f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 --2- 172.21.15.16:0/1060672961 >> v2:172.21.15.67:3300/0 conn(0x7ff3e40731d0 0x7ff3e406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 -- 172.21.15.16:0/1060672961 >> v1:172.21.15.67:6789/0 conn(0x7ff3e4154d00 legacy=0x7ff3e4072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:43.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.027+0000 7ff3d9400640 1 -- 172.21.15.16:0/1060672961 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e40c92f0 con 0x7ff3e41550e0 2024-04-17T15:10:43.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.031+0000 7ff3d9400640 1 --2- 172.21.15.16:0/1060672961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415b6b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40c6c50 tx=0x7ff3cc01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ef4101d1704adf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.035+0000 7ff3e1400640 1 -- 172.21.15.16:0/1060672961 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0b4070 con 0x7ff3e41550e0 2024-04-17T15:10:43.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.035+0000 7ff3e1400640 1 -- 172.21.15.16:0/1060672961 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff3cc0af400 con 0x7ff3e41550e0 2024-04-17T15:10:43.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.035+0000 7ff3e1400640 1 -- 172.21.15.16:0/1060672961 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0af7f0 con 0x7ff3e41550e0 2024-04-17T15:10:43.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.035+0000 7ff3e9200640 1 -- 172.21.15.16:0/1060672961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 msgr2=0x7ff3e415b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.035+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1060672961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415b6b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40c6c50 tx=0x7ff3cc01f1a0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- 172.21.15.16:0/1060672961 shutdown_connections 2024-04-17T15:10:43.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1060672961 >> v2:172.21.15.67:3300/0 conn(0x7ff3e40731d0 0x7ff3e406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1060672961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415b6b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- 172.21.15.16:0/1060672961 >> 172.21.15.16:0/1060672961 conn(0x7ff3e406ba30 msgr2=0x7ff3e406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:43.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- 172.21.15.16:0/1060672961 shutdown_connections 2024-04-17T15:10:43.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- 172.21.15.16:0/1060672961 wait complete. 2024-04-17T15:10:43.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 Processor -- start 2024-04-17T15:10:43.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- start start 2024-04-17T15:10:43.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3e40731d0 0x7ff3e414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3e4154d00 0x7ff3e414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c8960 con 0x7ff3e41550e0 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c98b0 con 0x7ff3e40731d0 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.039+0000 7ff3e9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e40c8ae0 con 0x7ff3e4154d00 2024-04-17T15:10:43.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.043+0000 7ff3e2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.043+0000 7ff3e2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54526/0 (socket says 172.21.15.16:54526) 2024-04-17T15:10:43.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.043+0000 7ff3e2800640 1 -- 172.21.15.16:0/1994484609 learned_addr learned my addr 172.21.15.16:0/1994484609 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:43.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.043+0000 7ff3d9400640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3e4154d00 0x7ff3e414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.043+0000 7ff3e1e00640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3e40731d0 0x7ff3e414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 -- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3e4154d00 msgr2=0x7ff3e414c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3e4154d00 0x7ff3e414c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 -- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3e40731d0 msgr2=0x7ff3e414bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3e40731d0 0x7ff3e414bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 -- 172.21.15.16:0/1994484609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e415ce00 con 0x7ff3e41550e0 2024-04-17T15:10:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.047+0000 7ff3e2800640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00b460 tx=0x7ff3dc00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc015020 con 0x7ff3e41550e0 2024-04-17T15:10:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff3dc011890 con 0x7ff3e41550e0 2024-04-17T15:10:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc011ca0 con 0x7ff3e41550e0 2024-04-17T15:10:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e414b890 con 0x7ff3e41550e0 2024-04-17T15:10:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41f1950 con 0x7ff3e41550e0 2024-04-17T15:10:43.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.051+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e4076280 con 0x7ff3e41550e0 2024-04-17T15:10:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.071+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3dc018020 con 0x7ff3e41550e0 2024-04-17T15:10:43.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.075+0000 7ff3daa00640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 0x7ff3c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.075+0000 7ff3e1e00640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 0x7ff3c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.075+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff3dc055030 con 0x7ff3e41550e0 2024-04-17T15:10:43.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.075+0000 7ff3e1e00640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 0x7ff3c006a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40016c0 tx=0x7ff3d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.339+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff3dc01f020 con 0x7ff3e41550e0 2024-04-17T15:10:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.539+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3e4158880 con 0x7ff3e41550e0 2024-04-17T15:10:43.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.555+0000 7ff3daa00640 1 -- 172.21.15.16:0/1994484609 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7ff3dc00d040 con 0x7ff3e41550e0 2024-04-17T15:10:43.557 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:43.557 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T15:10:43.557 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 msgr2=0x7ff3c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 0x7ff3c006a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40016c0 tx=0x7ff3d4009040 comp rx=0 tx=0).stop 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 msgr2=0x7ff3e415e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00b460 tx=0x7ff3dc00b920 comp rx=0 tx=0).stop 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 shutdown_connections 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7ff3c00683d0 0x7ff3c006a890 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3e41550e0 0x7ff3e415e760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3e4154d00 0x7ff3e414c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 --2- 172.21.15.16:0/1994484609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3e40731d0 0x7ff3e414bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 >> 172.21.15.16:0/1994484609 conn(0x7ff3e406ba30 msgr2=0x7ff3e406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:43.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 shutdown_connections 2024-04-17T15:10:43.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.559+0000 7ff3e9200640 1 -- 172.21.15.16:0/1994484609 wait complete. 2024-04-17T15:10:43.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T15:10:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 Processor -- start 2024-04-17T15:10:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 -- start start 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27ac06fca0 0x7f27ac15c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ac0c3e90 con 0x7f27ac06f8c0 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f27ac0ca350 con 0x7f27ac06fca0 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac15c2f0 con 0x7f27ac070110 2024-04-17T15:10:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b1800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f27ac06f8c0 0x7f27ac159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44812/0 (socket says 172.21.15.16:44812) 2024-04-17T15:10:43.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b1800640 1 -- 172.21.15.16:0/3882995245 learned_addr learned my addr 172.21.15.16:0/3882995245 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:43.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b2200640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.723+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3882995245 >> v2:172.21.15.67:3300/0 conn(0x7f27ac06fca0 0x7f27ac15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.727+0000 7f27abe00640 1 -- 172.21.15.16:0/3882995245 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65298731 0 0) 0x7f27ac0c3e90 con 0x7f27ac06f8c0 2024-04-17T15:10:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.727+0000 7f27abe00640 1 -- 172.21.15.16:0/3882995245 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2794003530 con 0x7f27ac06f8c0 2024-04-17T15:10:43.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.731+0000 7f27b0e00640 1 -- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 msgr2=0x7f27ac15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:43.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.731+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.731+0000 7f27b0e00640 1 -- 172.21.15.16:0/3882995245 >> v1:172.21.15.16:6789/0 conn(0x7f27ac06f8c0 legacy=0x7f27ac159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.731+0000 7f27b0e00640 1 -- 172.21.15.16:0/3882995245 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0ca5a0 con 0x7f27ac06fca0 2024-04-17T15:10:43.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.739+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06fca0 0x7f27ac15c780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27980097c0 tx=0x7f279801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b08c4278ce9a9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27abe00640 1 -- 172.21.15.16:0/3882995245 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980b5070 con 0x7f27ac06fca0 2024-04-17T15:10:43.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27abe00640 1 -- 172.21.15.16:0/3882995245 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f27980a8990 con 0x7f27ac06fca0 2024-04-17T15:10:43.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27abe00640 1 -- 172.21.15.16:0/3882995245 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980a8d80 con 0x7f27ac06fca0 2024-04-17T15:10:43.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 -- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06fca0 msgr2=0x7f27ac15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06fca0 0x7f27ac15c780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27980097c0 tx=0x7f279801ec90 comp rx=0 tx=0).stop 2024-04-17T15:10:43.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 -- 172.21.15.16:0/3882995245 shutdown_connections 2024-04-17T15:10:43.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3882995245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06fca0 0x7f27ac15c780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 -- 172.21.15.16:0/3882995245 >> 172.21.15.16:0/3882995245 conn(0x7f27ac06e1d0 msgr2=0x7f27ac06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:43.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.747+0000 7f27b2c00640 1 -- 172.21.15.16:0/3882995245 shutdown_connections 2024-04-17T15:10:43.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 -- 172.21.15.16:0/3882995245 wait complete. 2024-04-17T15:10:43.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 Processor -- start 2024-04-17T15:10:43.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 -- start start 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06f8c0 0x7f27ac1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0c3bd0 con 0x7f27ac06fca0 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0c3a50 con 0x7f27ac06f8c0 2024-04-17T15:10:43.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b2c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac152670 con 0x7f27ac070110 2024-04-17T15:10:43.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54528/0 (socket says 172.21.15.16:54528) 2024-04-17T15:10:43.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.751+0000 7f27b0e00640 1 -- 172.21.15.16:0/3964098385 learned_addr learned my addr 172.21.15.16:0/3964098385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:43.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b2200640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b1800640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06f8c0 0x7f27ac1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b0e00640 1 -- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 msgr2=0x7f27ac154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b0e00640 1 -- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06f8c0 msgr2=0x7f27ac1481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:43.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06f8c0 0x7f27ac1481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:43.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.755+0000 7f27b0e00640 1 -- 172.21.15.16:0/3964098385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac155290 con 0x7f27ac06fca0 2024-04-17T15:10:43.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.759+0000 7f27b0e00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f279801b8a0 tx=0x7f279801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980b5040 con 0x7f27ac06fca0 2024-04-17T15:10:43.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f27980bf070 con 0x7f27ac06fca0 2024-04-17T15:10:43.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980b1a70 con 0x7f27ac06fca0 2024-04-17T15:10:43.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac154040 con 0x7f27ac06fca0 2024-04-17T15:10:43.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac149b20 con 0x7f27ac06fca0 2024-04-17T15:10:43.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.763+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac0761a0 con 0x7f27ac06fca0 2024-04-17T15:10:43.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.783+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27980b1c10 con 0x7f27ac06fca0 2024-04-17T15:10:43.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.787+0000 7f27a9600640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 0x7f278c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:43.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.787+0000 7f27b1800640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 0x7f278c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:43.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.787+0000 7f27b1800640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 0x7f278c06a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27a0007fd0 tx=0x7f27a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:43.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:43.787+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f27980f25d0 con 0x7f27ac06fca0 2024-04-17T15:10:44.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.055+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f27980187f0 con 0x7f27ac06fca0 2024-04-17T15:10:44.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.255+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27ac151c20 con 0x7f27ac06fca0 2024-04-17T15:10:44.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.267+0000 7f27a9600640 1 -- 172.21.15.16:0/3964098385 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6844 (secure 0 0 0) 0x7f27980f4c30 con 0x7f27ac06fca0 2024-04-17T15:10:44.269 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2639298034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2639298034},{"type":"v1","addr":"172.21.15.16:6833","nonce":2639298034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4103322095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4103322095},{"type":"v1","addr":"172.21.15.16:6835","nonce":4103322095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2864735090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2864735090},{"type":"v1","addr":"172.21.15.16:6837","nonce":2864735090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/364901983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":364901983},{"type":"v1","addr":"172.21.15.67:6837","nonce":364901983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/1965219336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":1965219336},{"type":"v1","addr":"172.21.15.67:6839","nonce":1965219336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T14:39:58.980805+0000","modified":"2024-04-17T14:40:04.134775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14216":{"gid":14216,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6835/4079650926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4079650926},{"type":"v1","addr":"172.21.15.67:6835","nonce":4079650926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14216,"qdb_cluster":[14216]},"id":1}]} 2024-04-17T15:10:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 msgr2=0x7f278c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 0x7f278c06a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27a0007fd0 tx=0x7f27a0009040 comp rx=0 tx=0).stop 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 msgr2=0x7f27ac15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f279801b8a0 tx=0x7f279801ba30 comp rx=0 tx=0).stop 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 shutdown_connections 2024-04-17T15:10:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f278c0683d0 0x7f278c06a890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27ac070110 0x7f27ac154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27ac06fca0 0x7f27ac15b150 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 --2- 172.21.15.16:0/3964098385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27ac06f8c0 0x7f27ac1481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 >> 172.21.15.16:0/3964098385 conn(0x7f27ac06e1d0 msgr2=0x7f27ac157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 shutdown_connections 2024-04-17T15:10:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.271+0000 7f27b2c00640 1 -- 172.21.15.16:0/3964098385 wait complete. 2024-04-17T15:10:44.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:10:44.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 Processor -- start 2024-04-17T15:10:44.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 -- start start 2024-04-17T15:10:44.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 0x7f22140ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22140c38e0 con 0x7f22140c48e0 2024-04-17T15:10:44.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22140ca2c0 con 0x7f2214152dd0 2024-04-17T15:10:44.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.431+0000 7f221c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f22140ca5a0 con 0x7f22140c8f10 2024-04-17T15:10:44.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.435+0000 7f221a400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f22140c48e0 0x7f22140cafa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44818/0 (socket says 172.21.15.16:44818) 2024-04-17T15:10:44.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.435+0000 7f221a400640 1 -- 172.21.15.16:0/4056892415 learned_addr learned my addr 172.21.15.16:0/4056892415 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:44.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.435+0000 7f2219000640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 0x7f22140ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.435+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238903532 0 0) 0x7f22140c38e0 con 0x7f22140c48e0 2024-04-17T15:10:44.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.435+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21fc003530 con 0x7f22140c48e0 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1261964762 0 0) 0x7f21fc003530 con 0x7f22140c48e0 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 msgr2=0x7f22140ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 0x7f22140ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 >> v1:172.21.15.67:6789/0 conn(0x7f2214152dd0 legacy=0x7f221415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221415c290 con 0x7f22140c48e0 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3264374569 0 0) 0x7f220c001a00 con 0x7f22140c48e0 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 >> v1:172.21.15.16:6789/0 conn(0x7f22140c48e0 legacy=0x7f22140cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21fc0039f0 0x7f21fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f21fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 0x7f21fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22140ca5a0 con 0x7f21fc004810 2024-04-17T15:10:44.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc00bae0 con 0x7f21fc0039f0 2024-04-17T15:10:44.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc00bce0 con 0x7f22140c8f10 2024-04-17T15:10:44.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.439+0000 7f2219000640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f21fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.443+0000 7f2219a00640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21fc0039f0 0x7f21fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 -- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 msgr2=0x7f21fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:44.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22140c8f10 0x7f21fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 -- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21fc0039f0 msgr2=0x7f21fc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:44.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21fc0039f0 0x7f21fc003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 -- 172.21.15.16:0/4056892415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc003530 con 0x7f21fc004810 2024-04-17T15:10:44.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.447+0000 7f2219000640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f21fc004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2200009ab0 tx=0x7f220001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe75a72f42937961 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:44.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.451+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22000b2070 con 0x7f21fc004810 2024-04-17T15:10:44.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.451+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22000a5660 con 0x7f21fc004810 2024-04-17T15:10:44.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.451+0000 7f2213e00640 1 -- 172.21.15.16:0/4056892415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22000096b0 con 0x7f21fc004810 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- 172.21.15.16:0/4056892415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 msgr2=0x7f21fc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 --2- 172.21.15.16:0/4056892415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f21fc004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2200009ab0 tx=0x7f220001ca70 comp rx=0 tx=0).stop 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221a400640 1 -- 172.21.15.16:0/4056892415 reap_dead start 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- 172.21.15.16:0/4056892415 shutdown_connections 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- 172.21.15.16:0/4056892415 >> 172.21.15.16:0/4056892415 conn(0x7f22140716a0 msgr2=0x7f2214071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- 172.21.15.16:0/4056892415 shutdown_connections 2024-04-17T15:10:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- 172.21.15.16:0/4056892415 wait complete. 2024-04-17T15:10:44.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 Processor -- start 2024-04-17T15:10:44.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- start start 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22141f14a0 0x7f22141490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22141495f0 0x7f221406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22140c3530 con 0x7f21fc004810 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2214158b80 con 0x7f22141f14a0 2024-04-17T15:10:44.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f221c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f22141f0aa0 con 0x7f22141495f0 2024-04-17T15:10:44.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.455+0000 7f2219a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54554/0 (socket says 172.21.15.16:54554) 2024-04-17T15:10:44.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 -- 172.21.15.16:0/2174502471 learned_addr learned my addr 172.21.15.16:0/2174502471 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:44.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219000640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22141f14a0 0x7f22141490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f221a400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22141495f0 0x7f221406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 -- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22141495f0 msgr2=0x7f221406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22141495f0 0x7f221406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 -- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22141f14a0 msgr2=0x7f22141490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22141f14a0 0x7f22141490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.459+0000 7f2219a00640 1 -- 172.21.15.16:0/2174502471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141f1900 con 0x7f21fc004810 2024-04-17T15:10:44.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.463+0000 7f2219a00640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f220800d7a0 tx=0x7f220800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:44.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208005270 con 0x7f21fc004810 2024-04-17T15:10:44.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2214149a70 con 0x7f21fc004810 2024-04-17T15:10:44.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22140b3340 con 0x7f21fc004810 2024-04-17T15:10:44.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2214076280 con 0x7f21fc004810 2024-04-17T15:10:44.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2208017070 con 0x7f21fc004810 2024-04-17T15:10:44.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.467+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208001240 con 0x7f21fc004810 2024-04-17T15:10:44.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.487+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f220800b6b0 con 0x7f21fc004810 2024-04-17T15:10:44.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.487+0000 7f2211600640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 0x7f21f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:44.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.487+0000 7f2219000640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 0x7f21f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:44.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.491+0000 7f2219000640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 0x7f21f406a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22000af000 tx=0x7f22000046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:44.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.751+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2208055420 con 0x7f21fc004810 2024-04-17T15:10:44.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.751+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2208057120 con 0x7f21fc004810 2024-04-17T15:10:44.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.919+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22140c97a0 con 0x7f21fc004810 2024-04-17T15:10:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.959+0000 7f2211600640 1 -- 172.21.15.16:0/2174502471 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16609 (secure 0 0 0) 0x7f220805b420 con 0x7f21fc004810 2024-04-17T15:10:44.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-17T15:10:44.960 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"a4da2728-df57-41cc-8313-34e85a419083","created":"2024-04-17T14:38:59.746715+0000","modified":"2024-04-17T14:40:09.312032+0000","last_up_change":"2024-04-17T14:39:17.210448+0000","last_in_change":"2024-04-17T14:39:07.510170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T14:39:17.815818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T14:39:56.221860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T14:39:57.848198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5867be69-408d-4083-b813-50ab0974d3ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6807","nonce":2573416499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6811","nonce":2573416499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6815","nonce":2573416499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2573416499},{"type":"v1","addr":"172.21.15.16:6813","nonce":2573416499}]},"public_addr":"172.21.15.16:6807/2573416499","cluster_addr":"172.21.15.16:6811/2573416499","heartbeat_back_addr":"172.21.15.16:6815/2573416499","heartbeat_front_addr":"172.21.15.16:6813/2573416499","state":["exists","up"]},{"osd":1,"uuid":"f55759fe-4003-42e2-8361-397d42b91329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6825","nonce":1749404511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6827","nonce":1749404511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6831","nonce":1749404511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1749404511},{"type":"v1","addr":"172.21.15.16:6829","nonce":1749404511}]},"public_addr":"172.21.15.16:6825/1749404511","cluster_addr":"172.21.15.16:6827/1749404511","heartbeat_back_addr":"172.21.15.16:6831/1749404511","heartbeat_front_addr":"172.21.15.16:6829/1749404511","state":["exists","up"]},{"osd":2,"uuid":"112b128c-3596-4679-93a3-b3217a8a197b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6801","nonce":2077249539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6803","nonce":2077249539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6810","nonce":2077249539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":2077249539},{"type":"v1","addr":"172.21.15.16:6806","nonce":2077249539}]},"public_addr":"172.21.15.16:6801/2077249539","cluster_addr":"172.21.15.16:6803/2077249539","heartbeat_back_addr":"172.21.15.16:6810/2077249539","heartbeat_front_addr":"172.21.15.16:6806/2077249539","state":["exists","up"]},{"osd":3,"uuid":"6abe9b5d-23c1-46db-a0f2-3fa0974a422b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6817","nonce":274422145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6819","nonce":274422145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6823","nonce":274422145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":274422145},{"type":"v1","addr":"172.21.15.16:6821","nonce":274422145}]},"public_addr":"172.21.15.16:6817/274422145","cluster_addr":"172.21.15.16:6819/274422145","heartbeat_back_addr":"172.21.15.16:6823/274422145","heartbeat_front_addr":"172.21.15.16:6821/274422145","state":["exists","up"]},{"osd":4,"uuid":"1f957d0f-7b28-45b4-a073-eecbd0190aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6819","nonce":2915598098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6821","nonce":2915598098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6825","nonce":2915598098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":2915598098},{"type":"v1","addr":"172.21.15.67:6823","nonce":2915598098}]},"public_addr":"172.21.15.67:6819/2915598098","cluster_addr":"172.21.15.67:6821/2915598098","heartbeat_back_addr":"172.21.15.67:6825/2915598098","heartbeat_front_addr":"172.21.15.67:6823/2915598098","state":["exists","up"]},{"osd":5,"uuid":"30cc82f3-49bd-40a5-ba7e-93664936002d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6811","nonce":1857257902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6813","nonce":1857257902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6817","nonce":1857257902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1857257902},{"type":"v1","addr":"172.21.15.67:6815","nonce":1857257902}]},"public_addr":"172.21.15.67:6811/1857257902","cluster_addr":"172.21.15.67:6813/1857257902","heartbeat_back_addr":"172.21.15.67:6817/1857257902","heartbeat_front_addr":"172.21.15.67:6815/1857257902","state":["exists","up"]},{"osd":6,"uuid":"e969e708-f337-4e5f-b3d3-20f8e23ebe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6827","nonce":3773130679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6829","nonce":3773130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6833","nonce":3773130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3773130679},{"type":"v1","addr":"172.21.15.67:6831","nonce":3773130679}]},"public_addr":"172.21.15.67:6827/3773130679","cluster_addr":"172.21.15.67:6829/3773130679","heartbeat_back_addr":"172.21.15.67:6833/3773130679","heartbeat_front_addr":"172.21.15.67:6831/3773130679","state":["exists","up"]},{"osd":7,"uuid":"a2a5b1c4-01c2-4807-a639-ca8ec3a5044d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6803","nonce":1496189584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6805","nonce":1496189584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6809","nonce":1496189584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1496189584},{"type":"v1","addr":"172.21.15.67:6807","nonce":1496189584}]},"public_addr":"172.21.15.67:6803/1496189584","cluster_addr":"172.21.15.67:6805/1496189584","heartbeat_back_addr":"172.21.15.67:6809/1496189584","heartbeat_front_addr":"172.21.15.67:6807/1496189584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.416147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.581245+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.502002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.332749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.346882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.431569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T14:39:13.198550+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 msgr2=0x7f21f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 0x7f21f406a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22000af000 tx=0x7f22000046d0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 msgr2=0x7f22141f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f220800d7a0 tx=0x7f220800dc60 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 shutdown_connections 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f21f40683b0 0x7f21f406a870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f22141495f0 0x7f221406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22141f14a0 0x7f22141490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 --2- 172.21.15.16:0/2174502471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21fc004810 0x7f22141f0f60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 >> 172.21.15.16:0/2174502471 conn(0x7f22140716a0 msgr2=0x7f2214158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 shutdown_connections 2024-04-17T15:10:44.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:44.963+0000 7f221c400640 1 -- 172.21.15.16:0/2174502471 wait complete. 2024-04-17T15:10:44.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T15:10:45.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.131+0000 7fef5ae00640 1 Processor -- start 2024-04-17T15:10:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.131+0000 7fef5ae00640 1 -- start start 2024-04-17T15:10:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.131+0000 7fef5ae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef540c5420 0x7fef5415c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.131+0000 7fef5ae00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef5415c5d0 0x7fef54163400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.135+0000 7fef5ae00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5415ca40 con 0x7fef54153000 2024-04-17T15:10:45.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.135+0000 7fef5ae00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fef540c8fb0 con 0x7fef5415c5d0 2024-04-17T15:10:45.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.135+0000 7fef5ae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fef540ca7d0 con 0x7fef540c5420 2024-04-17T15:10:45.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.147+0000 7fef58e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef5415c5d0 0x7fef54163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.147+0000 7fef58e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef5415c5d0 0x7fef54163400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54568/0 (socket says 172.21.15.16:54568) 2024-04-17T15:10:45.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.147+0000 7fef58e00640 1 -- 172.21.15.16:0/4011774079 learned_addr learned my addr 172.21.15.16:0/4011774079 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:45.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.151+0000 7fef58e00640 1 -- 172.21.15.16:0/4011774079 >> v2:172.21.15.67:3300/0 conn(0x7fef540c5420 msgr2=0x7fef5415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:45.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.151+0000 7fef58e00640 1 --2- 172.21.15.16:0/4011774079 >> v2:172.21.15.67:3300/0 conn(0x7fef540c5420 0x7fef5415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.151+0000 7fef58e00640 1 -- 172.21.15.16:0/4011774079 >> v1:172.21.15.67:6789/0 conn(0x7fef54153000 legacy=0x7fef540ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:45.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.151+0000 7fef58e00640 1 -- 172.21.15.16:0/4011774079 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef540706d0 con 0x7fef5415c5d0 2024-04-17T15:10:45.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.155+0000 7fef58e00640 1 --2- 172.21.15.16:0/4011774079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef5415c5d0 0x7fef54163400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef540cc150 tx=0x7fef4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56ba6ece78d0353 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:45.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef53400640 1 -- 172.21.15.16:0/4011774079 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a6040 con 0x7fef5415c5d0 2024-04-17T15:10:45.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef53400640 1 -- 172.21.15.16:0/4011774079 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef4c0af070 con 0x7fef5415c5d0 2024-04-17T15:10:45.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef53400640 1 -- 172.21.15.16:0/4011774079 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0aa880 con 0x7fef5415c5d0 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- 172.21.15.16:0/4011774079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef5415c5d0 msgr2=0x7fef54163400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 --2- 172.21.15.16:0/4011774079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef5415c5d0 0x7fef54163400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef540cc150 tx=0x7fef4c01c4e0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- 172.21.15.16:0/4011774079 shutdown_connections 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 --2- 172.21.15.16:0/4011774079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef5415c5d0 0x7fef54163400 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 --2- 172.21.15.16:0/4011774079 >> v2:172.21.15.67:3300/0 conn(0x7fef540c5420 0x7fef5415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- 172.21.15.16:0/4011774079 >> 172.21.15.16:0/4011774079 conn(0x7fef5406dc40 msgr2=0x7fef5406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- 172.21.15.16:0/4011774079 shutdown_connections 2024-04-17T15:10:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- 172.21.15.16:0/4011774079 wait complete. 2024-04-17T15:10:45.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 Processor -- start 2024-04-17T15:10:45.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 -- start start 2024-04-17T15:10:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.159+0000 7fef5ae00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef5ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef54153000 0x7fef540cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef5ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5415c5d0 0x7fef5414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef5ae00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef540ced90 con 0x7fef540c5420 2024-04-17T15:10:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef5ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef540c94e0 con 0x7fef54153000 2024-04-17T15:10:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef5ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fef540cef10 con 0x7fef5415c5d0 2024-04-17T15:10:45.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef53e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef53e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54576/0 (socket says 172.21.15.16:54576) 2024-04-17T15:10:45.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.163+0000 7fef53e00640 1 -- 172.21.15.16:0/2630279078 learned_addr learned my addr 172.21.15.16:0/2630279078 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:45.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 -- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5415c5d0 msgr2=0x7fef5414f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5415c5d0 0x7fef5414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 -- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef54153000 msgr2=0x7fef540cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef54153000 0x7fef540cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 -- 172.21.15.16:0/2630279078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5406d6d0 con 0x7fef540c5420 2024-04-17T15:10:45.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.167+0000 7fef53e00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c490 tx=0x7fef44001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.171+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44017070 con 0x7fef540c5420 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.171+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef44003600 con 0x7fef540c5420 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.171+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44003a10 con 0x7fef540c5420 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.171+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef541f7d80 con 0x7fef540c5420 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.171+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541f6fc0 con 0x7fef540c5420 2024-04-17T15:10:45.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.175+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef54151340 con 0x7fef540c5420 2024-04-17T15:10:45.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.195+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef4401a070 con 0x7fef540c5420 2024-04-17T15:10:45.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.195+0000 7fef50c00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 0x7fef3006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.195+0000 7fef4b400640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 0x7fef3006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.195+0000 7fef4b400640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 0x7fef3006a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef5415c330 tx=0x7fef3c009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.451+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fef44054560 con 0x7fef540c5420 2024-04-17T15:10:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.451+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fef44021070 con 0x7fef540c5420 2024-04-17T15:10:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.651+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fef5406e500 con 0x7fef540c5420 2024-04-17T15:10:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef50c00640 1 -- 172.21.15.16:0/2630279078 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fef44056bc0 con 0x7fef540c5420 2024-04-17T15:10:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T15:10:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 msgr2=0x7fef3006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 0x7fef3006a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef5415c330 tx=0x7fef3c009250 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 msgr2=0x7fef5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c490 tx=0x7fef44001e80 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 shutdown_connections 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fef300683d0 0x7fef3006a890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef5415c5d0 0x7fef5414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef54153000 0x7fef540cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 --2- 172.21.15.16:0/2630279078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef540c5420 0x7fef5406d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 >> 172.21.15.16:0/2630279078 conn(0x7fef5406dc40 msgr2=0x7fef54148090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.779+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 shutdown_connections 2024-04-17T15:10:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.783+0000 7fef5ae00640 1 -- 172.21.15.16:0/2630279078 wait complete. 2024-04-17T15:10:45.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T15:10:45.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 Processor -- start 2024-04-17T15:10:45.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 -- start start 2024-04-17T15:10:45.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20c01551a0 0x7f20c00c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c00c83a0 con 0x7f20c00c9370 2024-04-17T15:10:45.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f20c015e670 con 0x7f20c01551a0 2024-04-17T15:10:45.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c8000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20c015e910 con 0x7f20c00c7890 2024-04-17T15:10:45.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.947+0000 7f20c5600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f20c01551a0 0x7f20c00c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.951+0000 7f20c6000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f20c00c9370 0x7f20c0071c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.16:58048/0 (socket says 172.21.15.16:58048) 2024-04-17T15:10:45.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.951+0000 7f20c6000640 1 -- 172.21.15.16:0/4199960705 learned_addr learned my addr 172.21.15.16:0/4199960705 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:45.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.955+0000 7f20c4c00640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.959+0000 7f20c5600640 1 -- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 msgr2=0x7f20c015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:45.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.959+0000 7f20c5600640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.959+0000 7f20c5600640 1 -- 172.21.15.16:0/4199960705 >> v1:172.21.15.67:6789/0 conn(0x7f20c00c9370 legacy=0x7f20c0071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.959+0000 7f20c5600640 1 -- 172.21.15.16:0/4199960705 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c015ebf0 con 0x7f20c01551a0 2024-04-17T15:10:45.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.971+0000 7f20c5600640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c01551a0 0x7f20c00c7d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20b40097c0 tx=0x7f20b401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e3f9208661b42b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:45.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20bfe00640 1 -- 172.21.15.16:0/4199960705 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b40b5070 con 0x7f20c01551a0 2024-04-17T15:10:45.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20bfe00640 1 -- 172.21.15.16:0/4199960705 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20b40a8990 con 0x7f20c01551a0 2024-04-17T15:10:45.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20bfe00640 1 -- 172.21.15.16:0/4199960705 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b40a8d80 con 0x7f20c01551a0 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c01551a0 msgr2=0x7f20c00c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c01551a0 0x7f20c00c7d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20b40097c0 tx=0x7f20b401ec90 comp rx=0 tx=0).stop 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- 172.21.15.16:0/4199960705 shutdown_connections 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 --2- 172.21.15.16:0/4199960705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c01551a0 0x7f20c00c7d70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- 172.21.15.16:0/4199960705 >> 172.21.15.16:0/4199960705 conn(0x7f20c006ba30 msgr2=0x7f20c006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:45.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- 172.21.15.16:0/4199960705 shutdown_connections 2024-04-17T15:10:45.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- 172.21.15.16:0/4199960705 wait complete. 2024-04-17T15:10:45.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 Processor -- start 2024-04-17T15:10:45.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.983+0000 7f20c8000640 1 -- start start 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c00c9370 0x7f20c01f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0155580 con 0x7f20c01551a0 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20c015f1b0 con 0x7f20c00c9370 2024-04-17T15:10:45.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c8000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f20c0155700 con 0x7f20c00c7890 2024-04-17T15:10:45.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54588/0 (socket says 172.21.15.16:54588) 2024-04-17T15:10:45.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c6000640 1 -- 172.21.15.16:0/2950479473 learned_addr learned my addr 172.21.15.16:0/2950479473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:45.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c5600640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.987+0000 7f20c4c00640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c00c9370 0x7f20c01f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:45.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 -- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 msgr2=0x7f20c015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 -- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c00c9370 msgr2=0x7f20c01f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:45.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c00c9370 0x7f20c01f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:45.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 -- 172.21.15.16:0/2950479473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c014f840 con 0x7f20c01551a0 2024-04-17T15:10:45.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.991+0000 7f20c6000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f20b800cbf0 tx=0x7f20b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.995+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8017070 con 0x7f20c01551a0 2024-04-17T15:10:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.995+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c014fc20 con 0x7f20c01551a0 2024-04-17T15:10:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.995+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c014f560 con 0x7f20c01551a0 2024-04-17T15:10:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.995+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20b800ad40 con 0x7f20c01551a0 2024-04-17T15:10:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.995+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8021060 con 0x7f20c01551a0 2024-04-17T15:10:45.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:45.999+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c0076280 con 0x7f20c01551a0 2024-04-17T15:10:46.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.019+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20b801a070 con 0x7f20c01551a0 2024-04-17T15:10:46.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.019+0000 7f20bd600640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 0x7f20a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:46.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.019+0000 7f20c5600640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 0x7f20a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:46.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.019+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7f20b8054ed0 con 0x7f20c01551a0 2024-04-17T15:10:46.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.023+0000 7f20c5600640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 0x7f20a006a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20b40b2000 tx=0x7f20b40aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.283+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f20b8056e30 con 0x7f20c01551a0 2024-04-17T15:10:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:46.491+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f20c006c020 con 0x7f20c01551a0 2024-04-17T15:10:47.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.703+0000 7f20bd600640 1 -- 172.21.15.16:0/2950479473 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f20b805b130 con 0x7f20c01551a0 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 msgr2=0x7f20a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 0x7f20a006a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20b40b2000 tx=0x7f20b40aa070 comp rx=0 tx=0).stop 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 msgr2=0x7f20c01f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f20b800cbf0 tx=0x7f20b800a430 comp rx=0 tx=0).stop 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 shutdown_connections 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f20a00683b0 0x7f20a006a870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20c01551a0 0x7f20c01f1190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20c00c9370 0x7f20c01f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 --2- 172.21.15.16:0/2950479473 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20c00c7890 0x7f20c015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 >> 172.21.15.16:0/2950479473 conn(0x7f20c006ba30 msgr2=0x7f20c006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:47.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 shutdown_connections 2024-04-17T15:10:47.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.707+0000 7f20c8000640 1 -- 172.21.15.16:0/2950479473 wait complete. 2024-04-17T15:10:47.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T15:10:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 Processor -- start 2024-04-17T15:10:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 -- start start 2024-04-17T15:10:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac60158430 0x7fac6015e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac601655d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac60158810 con 0x7fac600b0e00 2024-04-17T15:10:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fac60070470 con 0x7fac60158430 2024-04-17T15:10:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac66000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fac6006bbd0 con 0x7fac6006d760 2024-04-17T15:10:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac64c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac60158430 0x7fac6015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac5fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fac600b0e00 0x7fac600c96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44820/0 (socket says 172.21.15.16:44820) 2024-04-17T15:10:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac5fe00640 1 -- 172.21.15.16:0/2292840722 learned_addr learned my addr 172.21.15.16:0/2292840722 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.875+0000 7fac65600640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac601655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.879+0000 7fac64c00640 1 -- 172.21.15.16:0/2292840722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 msgr2=0x7fac601655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.879+0000 7fac64c00640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac601655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.879+0000 7fac64c00640 1 -- 172.21.15.16:0/2292840722 >> v1:172.21.15.16:6789/0 conn(0x7fac600b0e00 legacy=0x7fac600c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.879+0000 7fac64c00640 1 -- 172.21.15.16:0/2292840722 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6006beb0 con 0x7fac60158430 2024-04-17T15:10:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.887+0000 7fac64c00640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015e240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac540097c0 tx=0x7fac5401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf322d5411b67b4d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac5f400640 1 -- 172.21.15.16:0/2292840722 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac540b5070 con 0x7fac60158430 2024-04-17T15:10:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac5f400640 1 -- 172.21.15.16:0/2292840722 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fac540a8990 con 0x7fac60158430 2024-04-17T15:10:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac5f400640 1 -- 172.21.15.16:0/2292840722 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac540a8d80 con 0x7fac60158430 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- 172.21.15.16:0/2292840722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 msgr2=0x7fac6015e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015e240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac540097c0 tx=0x7fac5401ec90 comp rx=0 tx=0).stop 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- 172.21.15.16:0/2292840722 shutdown_connections 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac601655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- 172.21.15.16:0/2292840722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015e240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- 172.21.15.16:0/2292840722 >> 172.21.15.16:0/2292840722 conn(0x7fac60062c10 msgr2=0x7fac6006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- 172.21.15.16:0/2292840722 shutdown_connections 2024-04-17T15:10:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- 172.21.15.16:0/2292840722 wait complete. 2024-04-17T15:10:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 Processor -- start 2024-04-17T15:10:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- start start 2024-04-17T15:10:47.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac6015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac600b0e00 0x7fac601f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac6015e780 con 0x7fac60158430 2024-04-17T15:10:47.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac6006c190 con 0x7fac600b0e00 2024-04-17T15:10:47.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.891+0000 7fac66000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7fac600cac00 con 0x7fac6006d760 2024-04-17T15:10:47.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.895+0000 7fac65600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.895+0000 7fac65600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54606/0 (socket says 172.21.15.16:54606) 2024-04-17T15:10:47.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.895+0000 7fac65600640 1 -- 172.21.15.16:0/4150332967 learned_addr learned my addr 172.21.15.16:0/4150332967 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:47.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.895+0000 7fac5fe00640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac600b0e00 0x7fac601f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.895+0000 7fac64c00640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac6015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 -- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 msgr2=0x7fac6015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac6015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 -- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac600b0e00 msgr2=0x7fac601f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac600b0e00 0x7fac601f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:47.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 -- 172.21.15.16:0/4150332967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6015ba90 con 0x7fac60158430 2024-04-17T15:10:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.899+0000 7fac65600640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac58009dd0 tx=0x7fac5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:47.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.903+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58018020 con 0x7fac60158430 2024-04-17T15:10:47.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.903+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fac58014480 con 0x7fac60158430 2024-04-17T15:10:47.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.903+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac601f4330 con 0x7fac60158430 2024-04-17T15:10:47.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.903+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58014890 con 0x7fac60158430 2024-04-17T15:10:47.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.903+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac601f48f0 con 0x7fac60158430 2024-04-17T15:10:47.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.907+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac600761a0 con 0x7fac60158430 2024-04-17T15:10:47.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.923+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac5801b020 con 0x7fac60158430 2024-04-17T15:10:47.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.923+0000 7fac5cc00640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 0x7fac4006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:47.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.927+0000 7fac64c00640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 0x7fac4006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:47.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:47.927+0000 7fac64c00640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 0x7fac4006a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac540b2000 tx=0x7fac54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:48.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.183+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7fac58055eb0 con 0x7fac60158430 2024-04-17T15:10:48.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.183+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fac58022030 con 0x7fac60158430 2024-04-17T15:10:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.351+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac600b0be0 con 0x7fac60158430 2024-04-17T15:10:48.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-17T15:10:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.863+0000 7fac5cc00640 1 -- 172.21.15.16:0/4150332967 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7fac58010040 con 0x7fac60158430 2024-04-17T15:10:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 msgr2=0x7fac4006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 0x7fac4006a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac540b2000 tx=0x7fac54008040 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 msgr2=0x7fac6015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac58009dd0 tx=0x7fac5800c490 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 shutdown_connections 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7fac400683d0 0x7fac4006a890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac60158430 0x7fac6015d2d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac600b0e00 0x7fac601f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 --2- 172.21.15.16:0/4150332967 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fac6006d760 0x7fac6015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 >> 172.21.15.16:0/4150332967 conn(0x7fac60062c10 msgr2=0x7fac600ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 shutdown_connections 2024-04-17T15:10:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:48.867+0000 7fac66000640 1 -- 172.21.15.16:0/4150332967 wait complete. 2024-04-17T15:10:48.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T15:10:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 Processor -- start 2024-04-17T15:10:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 -- start start 2024-04-17T15:10:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1910071ac0 0x7f19100c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19100c5920 0x7f19100c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1910157e50 con 0x7f1910151cf0 2024-04-17T15:10:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1910158180 con 0x7f19100c5920 2024-04-17T15:10:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1916000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f19100c5ef0 con 0x7f1910071ac0 2024-04-17T15:10:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f190fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19100c5920 0x7f19100c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f190f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1910151cf0 0x7f1910158610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44834/0 (socket says 172.21.15.16:44834) 2024-04-17T15:10:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f190f400640 1 -- 172.21.15.16:0/4245483882 learned_addr learned my addr 172.21.15.16:0/4245483882 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-17T15:10:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.039+0000 7f1906a00640 1 --2- 172.21.15.16:0/4245483882 >> v2:172.21.15.67:3300/0 conn(0x7f1910071ac0 0x7f19100c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.043+0000 7f190fe00640 1 -- 172.21.15.16:0/4245483882 >> v2:172.21.15.67:3300/0 conn(0x7f1910071ac0 msgr2=0x7f19100c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T15:10:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.043+0000 7f190fe00640 1 --2- 172.21.15.16:0/4245483882 >> v2:172.21.15.67:3300/0 conn(0x7f1910071ac0 0x7f19100c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.043+0000 7f190fe00640 1 -- 172.21.15.16:0/4245483882 >> v1:172.21.15.16:6789/0 conn(0x7f1910151cf0 legacy=0x7f1910158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.043+0000 7f190fe00640 1 -- 172.21.15.16:0/4245483882 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19100c61d0 con 0x7f19100c5920 2024-04-17T15:10:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.047+0000 7f190fe00640 1 --2- 172.21.15.16:0/4245483882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f19100c3800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19100c9ec0 tx=0x7f190801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361f02a88353b905 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:49.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f190ea00640 1 -- 172.21.15.16:0/4245483882 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080b5070 con 0x7f19100c5920 2024-04-17T15:10:49.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f190ea00640 1 -- 172.21.15.16:0/4245483882 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f19080a8970 con 0x7f19100c5920 2024-04-17T15:10:49.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f190ea00640 1 -- 172.21.15.16:0/4245483882 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080a8d60 con 0x7f19100c5920 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 -- 172.21.15.16:0/4245483882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 msgr2=0x7f19100c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 --2- 172.21.15.16:0/4245483882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f19100c3800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19100c9ec0 tx=0x7f190801ec70 comp rx=0 tx=0).stop 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 -- 172.21.15.16:0/4245483882 shutdown_connections 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 --2- 172.21.15.16:0/4245483882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f19100c3800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 --2- 172.21.15.16:0/4245483882 >> v2:172.21.15.67:3300/0 conn(0x7f1910071ac0 0x7f19100c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 -- 172.21.15.16:0/4245483882 >> 172.21.15.16:0/4245483882 conn(0x7f191006ba30 msgr2=0x7f191006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 -- 172.21.15.16:0/4245483882 shutdown_connections 2024-04-17T15:10:49.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.051+0000 7f1916000640 1 -- 172.21.15.16:0/4245483882 wait complete. 2024-04-17T15:10:49.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 Processor -- start 2024-04-17T15:10:49.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 -- start start 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1910071ac0 0x7f1910153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1910151cf0 0x7f19101550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f19101520d0 con 0x7f19100c5920 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19100c6790 con 0x7f1910071ac0 2024-04-17T15:10:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1916000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 -- 0x7f1910152250 con 0x7f1910151cf0 2024-04-17T15:10:49.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1906a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1906a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54634/0 (socket says 172.21.15.16:54634) 2024-04-17T15:10:49.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f1906a00640 1 -- 172.21.15.16:0/2669737011 learned_addr learned my addr 172.21.15.16:0/2669737011 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-17T15:10:49.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f190fe00640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1910151cf0 0x7f19101550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.055+0000 7f190f400640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1910071ac0 0x7f1910153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.059+0000 7f1906a00640 1 -- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1910151cf0 msgr2=0x7f19101550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.059+0000 7f1906a00640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1910151cf0 0x7f19101550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.059+0000 7f1906a00640 1 -- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1910071ac0 msgr2=0x7f1910153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.059+0000 7f1906a00640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1910071ac0 0x7f1910153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.059+0000 7f1906a00640 1 -- 172.21.15.16:0/2669737011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1910154670 con 0x7f19100c5920 2024-04-17T15:10:49.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.063+0000 7f1906a00640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18f800e930 tx=0x7f18f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x7f19100c5920 2024-04-17T15:10:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f18f800ca00 con 0x7f19100c5920 2024-04-17T15:10:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f800cdd0 con 0x7f19100c5920 2024-04-17T15:10:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19100ca2a0 con 0x7f19100c5920 2024-04-17T15:10:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19101548e0 con 0x7f19100c5920 2024-04-17T15:10:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.067+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1910076280 con 0x7f19100c5920 2024-04-17T15:10:49.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.087+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18f801a070 con 0x7f19100c5920 2024-04-17T15:10:49.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.087+0000 7f1907e00640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 0x7f18ec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T15:10:49.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.087+0000 7f190f400640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 0x7f18ec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T15:10:49.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.087+0000 7f190f400640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 0x7f18ec06a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19000012f0 tx=0x7f19000019a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T15:10:49.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.347+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5386+0+0 (secure 0 0 0) 0x7f18f8055260 con 0x7f19100c5920 2024-04-17T15:10:49.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.347+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f18f80571c0 con 0x7f19100c5920 2024-04-17T15:10:49.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:49.539+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f19100c8a60 con 0x7f19100c5920 2024-04-17T15:10:50.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.027+0000 7f1907e00640 1 -- 172.21.15.16:0/2669737011 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f18f805b4c0 con 0x7f19100c5920 2024-04-17T15:10:50.029 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 msgr2=0x7f18ec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 0x7f18ec06a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19000012f0 tx=0x7f19000019a0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 msgr2=0x7f1910152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18f800e930 tx=0x7f18f800edf0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 shutdown_connections 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:6800/3551347273,v1:172.21.15.67:6801/3551347273] conn(0x7f18ec0683d0 0x7f18ec06a890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1910151cf0 0x7f19101550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19100c5920 0x7f1910152870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 --2- 172.21.15.16:0/2669737011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1910071ac0 0x7f1910153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T15:10:50.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 >> 172.21.15.16:0/2669737011 conn(0x7f191006ba30 msgr2=0x7f1910072120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T15:10:50.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 shutdown_connections 2024-04-17T15:10:50.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-17T15:10:50.031+0000 7f1916000640 1 -- 172.21.15.16:0/2669737011 wait complete. 2024-04-17T15:10:50.054 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T15:10:50.054 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T15:10:50.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:10:50.069 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-17T15:10:50.059+0000 b9ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 31792) UID: 0 2024-04-17T15:10:50.069 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-17T15:10:50.059+0000 b9ef640 -1 mds.a *** got signal Terminated *** 2024-04-17T15:10:55.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-17T15:10:55.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2024-04-17T15:10:56.156 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T15:10:56.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T15:10:56.157 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:10:56.173 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-17T15:10:56.163+0000 b9ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 31794) UID: 0 2024-04-17T15:10:56.173 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-17T15:10:56.163+0000 b9ef640 -1 mds.c *** got signal Terminated *** 2024-04-17T15:11:01.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-17T15:11:01.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~14s 2024-04-17T15:11:01.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-17T15:11:02.259 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T15:11:02.260 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-17T15:11:02.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:02.276 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-17T15:11:02.263+0000 b9ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 31797) UID: 0 2024-04-17T15:11:02.276 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-17T15:11:02.267+0000 b9ef640 -1 mds.e *** got signal Terminated *** 2024-04-17T15:11:05.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:11:05.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:11:08.362 INFO:tasks.ceph.mds.e:Stopped 2024-04-17T15:11:08.362 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T15:11:08.362 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:08.378 INFO:tasks.ceph.mds.b.smithi067.stderr:2024-04-17T15:11:08.366+0000 b9ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 33481) UID: 0 2024-04-17T15:11:08.379 INFO:tasks.ceph.mds.b.smithi067.stderr:2024-04-17T15:11:08.366+0000 b9ef640 -1 mds.b *** got signal Terminated *** 2024-04-17T15:11:08.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-04-17T15:11:08.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2024-04-17T15:11:08.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-17T15:11:10.558 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:34.924 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.564 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:34.930 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.601 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:34.908 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.622 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:34.938 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.630 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:34.947 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.634 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:34.940 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.682 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:35.048 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.793 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:35.099 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:10.904 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:35.220 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:14.464 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T15:11:14.465 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-17T15:11:14.465 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:14.504 INFO:tasks.ceph.mds.d.smithi067.stderr:2024-04-17T15:11:14.474+0000 b9ef640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 33480) UID: 0 2024-04-17T15:11:14.505 INFO:tasks.ceph.mds.d.smithi067.stderr:2024-04-17T15:11:14.478+0000 b9ef640 -1 mds.d *** got signal Terminated *** 2024-04-17T15:11:14.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~27s 2024-04-17T15:11:14.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-04-17T15:11:20.566 INFO:tasks.ceph.mds.d:Stopped 2024-04-17T15:11:20.566 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-17T15:11:20.566 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:20.567 INFO:tasks.ceph.mds.f:Stopped 2024-04-17T15:11:20.567 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T15:11:20.567 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T15:11:20.567 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:20.568 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T15:11:20.566+0000 7f8718400640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27766) UID: 0 2024-04-17T15:11:20.568 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-17T15:11:20.566+0000 7f8718400640 -1 osd.0 33 *** Got signal Terminated *** 2024-04-17T15:11:21.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-17T15:11:26.668 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T15:11:26.669 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T15:11:26.669 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:26.670 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T15:11:26.670+0000 7f5e17e00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27769) UID: 0 2024-04-17T15:11:26.670 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T15:11:26.670+0000 7f5e17e00640 -1 osd.1 34 *** Got signal Terminated *** 2024-04-17T15:11:27.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-17T15:11:27.525 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-17T15:11:27.522+0000 7f5e1a600640 -1 monclient: get_auth_request but no auth handler is set up 2024-04-17T15:11:32.372 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:56.738 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.426 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:56.792 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.455 INFO:tasks.ceph.mon.a.smithi016.stderr:==00:00:32:56.822 27654== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.548 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:56.854 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.552 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:56.858 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.554 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:56.871 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.562 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:56.878 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.597 INFO:tasks.ceph.mon.b.smithi067.stderr:==00:00:32:56.913 28204== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.611 INFO:tasks.ceph.mon.c.smithi067.stderr:==00:00:32:56.918 28203== Warning: unimplemented fcntl command: 1036 2024-04-17T15:11:32.770 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T15:11:32.770 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T15:11:32.770 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:32.771 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T15:11:32.770+0000 7fb90aa00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27768) UID: 0 2024-04-17T15:11:32.771 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-17T15:11:32.770+0000 7fb90aa00640 -1 osd.2 36 *** Got signal Terminated *** 2024-04-17T15:11:33.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-17T15:11:33.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-17T15:11:35.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:11:35.951 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:11:38.872 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T15:11:38.873 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T15:11:38.873 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:38.874 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T15:11:38.874+0000 7f1c93800640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27773) UID: 0 2024-04-17T15:11:38.874 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-17T15:11:38.874+0000 7f1c93800640 -1 osd.3 37 *** Got signal Terminated *** 2024-04-17T15:11:39.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-17T15:11:39.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-17T15:11:44.974 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T15:11:44.974 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T15:11:44.975 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:44.976 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T15:11:44.973+0000 7feae9661640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28598) UID: 0 2024-04-17T15:11:44.976 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-04-17T15:11:44.973+0000 7feae9661640 -1 osd.4 38 *** Got signal Terminated *** 2024-04-17T15:11:45.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-17T15:11:45.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-17T15:11:51.076 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T15:11:51.077 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T15:11:51.077 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:51.078 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T15:11:51.077+0000 7f4746b1f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28599) UID: 0 2024-04-17T15:11:51.078 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-04-17T15:11:51.077+0000 7f4746b1f640 -1 osd.5 39 *** Got signal Terminated *** 2024-04-17T15:11:51.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-17T15:11:51.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-17T15:11:56.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-17T15:11:56.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-17T15:11:57.178 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T15:11:57.179 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T15:11:57.179 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:11:57.180 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T15:11:57.181+0000 7fce33afd640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28603) UID: 0 2024-04-17T15:11:57.180 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-04-17T15:11:57.181+0000 7fce33afd640 -1 osd.6 40 *** Got signal Terminated *** 2024-04-17T15:12:02.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-17T15:12:02.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-17T15:12:03.281 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T15:12:03.281 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T15:12:03.281 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:12:03.283 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T15:12:03.285+0000 7ffa2b273640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28602) UID: 0 2024-04-17T15:12:03.283 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-04-17T15:12:03.285+0000 7ffa2b273640 -1 osd.7 40 *** Got signal Terminated *** 2024-04-17T15:12:05.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:12:06.001 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:12:07.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-17T15:12:07.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-17T15:12:09.383 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T15:12:09.383 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T15:12:09.384 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T15:12:09.384 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:12:09.440 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T15:12:09.441 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T15:12:09.441 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:12:09.442 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T15:12:09.445+0000 7f7e1ac88640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 28201) UID: 0 2024-04-17T15:12:09.442 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-04-17T15:12:09.445+0000 7f7e1ac88640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-17T15:12:09.471 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T15:12:09.471 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T15:12:09.471 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T15:12:09.471 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:12:09.489 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-17T15:12:09.478+0000 a391640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27650) UID: 0 2024-04-17T15:12:09.490 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-17T15:12:09.478+0000 a391640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-17T15:12:13.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-17T15:12:36.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:12:36.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:13:06.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:13:06.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:13:36.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:13:36.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:14:06.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:14:06.239 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:14:36.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:14:36.290 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:06.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:06.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:12.511 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T15:15:12.512 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T15:15:12.512 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:15:12.554 INFO:tasks.ceph.mon.b.smithi067.stderr:2024-04-17T15:15:12.521+0000 a391640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 28196) UID: 0 2024-04-17T15:15:12.555 INFO:tasks.ceph.mon.b.smithi067.stderr:2024-04-17T15:15:12.525+0000 a391640 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2024-04-17T15:15:13.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-17T15:15:18.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2024-04-17T15:15:18.614 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T15:15:18.615 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T15:15:18.615 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:15:18.657 INFO:tasks.ceph.mon.c.smithi067.stderr:2024-04-17T15:15:18.629+0000 a391640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 28199) UID: 0 2024-04-17T15:15:18.658 INFO:tasks.ceph.mon.c.smithi067.stderr:2024-04-17T15:15:18.633+0000 a391640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-17T15:15:23.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-17T15:15:23.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-17T15:15:24.717 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T15:15:24.717 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T15:15:24.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-17T15:15:24.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:15:24.756 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T15:15:25.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:15:25.034 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T15:15:25.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:15:25.230 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T15:15:25.446 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:15:25.446 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T15:15:25.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T15:15:25.622 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T15:15:25.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T15:15:25.832 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T15:15:26.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T15:15:26.060 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T15:15:26.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T15:15:26.377 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T15:15:26.528 INFO:tasks.ceph:Archiving mon data... 2024-04-17T15:15:26.529 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/data/mon.a.tgz 2024-04-17T15:15:26.530 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-17T15:15:26.539 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.ZUNgWN3O3t 2024-04-17T15:15:26.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZUNgWN3O3t 2024-04-17T15:15:26.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.ZUNgWN3O3t 2024-04-17T15:15:26.742 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.ZUNgWN3O3t is 323KB 2024-04-17T15:15:26.807 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.ZUNgWN3O3t 2024-04-17T15:15:26.816 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/data/mon.b.tgz 2024-04-17T15:15:26.816 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-04-17T15:15:26.822 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.t1DFBRhb94 2024-04-17T15:15:26.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.t1DFBRhb94 2024-04-17T15:15:26.952 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.t1DFBRhb94 2024-04-17T15:15:27.019 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.t1DFBRhb94 is 353KB 2024-04-17T15:15:27.079 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.t1DFBRhb94 2024-04-17T15:15:27.085 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/data/mon.c.tgz 2024-04-17T15:15:27.085 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-04-17T15:15:27.134 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.UyLKzSPKXW 2024-04-17T15:15:27.135 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.UyLKzSPKXW 2024-04-17T15:15:27.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.UyLKzSPKXW 2024-04-17T15:15:27.331 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.UyLKzSPKXW is 364KB 2024-04-17T15:15:27.392 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.UyLKzSPKXW 2024-04-17T15:15:27.398 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T15:15:27.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T15:15:27.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T15:15:27.594 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun 2024-04-17T15:15:27.802 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T15:15:27.804 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi016/crash 2024-04-17T15:15:27.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T15:15:27.828 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi067/crash 2024-04-17T15:15:27.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T15:15:27.842 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T15:15:27.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:27.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:27.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:27.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:27.968 INFO:tasks.ceph:Compressing logs... 2024-04-17T15:15:27.968 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T15:15:28.000 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T15:15:28.032 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2024-04-17T15:15:28.032 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31801.log 2024-04-17T15:15:28.033 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34402.log 2024-04-17T15:15:28.033 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2024-04-17T15:15:28.034 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T15:15:28.035 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31801.log.gz 2024-04-17T15:15:28.036 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32280.log 2024-04-17T15:15:28.036 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34402.log.gz 2024-04-17T15:15:28.036 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33320.log 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34064.log 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32280.log.gz 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34480.log 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33320.log.gz 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33346.log 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34064.log.gz 2024-04-17T15:15:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34480.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T15:15:28.042 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34480.log.gz 2024-04-17T15:15:28.042 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32447.log 2024-04-17T15:15:28.042 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33346.log.gz 2024-04-17T15:15:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28396.log 2024-04-17T15:15:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28317.log 2024-04-17T15:15:28.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28396.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28396.log.gz 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28317.log.gz 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28469.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.28469.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28469.log.gz 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28493.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28445.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28341.log: /var/log/ceph/ceph-client.admin.28493.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28493.log.gz 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2024-04-17T15:15:28.049 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28445.log.gz 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28420.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28420.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-mgr.x.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28420.log.gz 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28365.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.28365.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28365.log.gz 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T15:15:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-17T15:15:28.053 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.d.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T15:15:28.053 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-04-17T15:15:28.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/mon.c.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-17T15:15:28.054 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33268.log 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33995.log 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32447.log.gz 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32630.log 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33268.log.gz 2024-04-17T15:15:28.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34350.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33995.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33216.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32630.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34350.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33453.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33216.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32733.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33453.log.gz 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32176.log 2024-04-17T15:15:28.057 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32733.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27657.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32176.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32176.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.27657.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33034.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34819.log 2024-04-17T15:15:28.058 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32228.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33034.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34819.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34819.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33086.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32228.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34246.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33086.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34116.log 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-04-17T15:15:28.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32457.log 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/mds.f.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr: 95.3% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr: 57.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-17T15:15:28.065 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/mds.d.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-04-17T15:15:28.066 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T15:15:28.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T15:15:28.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.b.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-17T15:15:28.066 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T15:15:28.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.b.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T15:15:28.068 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34246.log.gz 2024-04-17T15:15:28.068 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34021.log 2024-04-17T15:15:28.068 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34116.log.gz 2024-04-17T15:15:28.068 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-04-17T15:15:28.068 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32457.log.gz 2024-04-17T15:15:28.069 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-04-17T15:15:28.069 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-04-17T15:15:28.069 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22849.log 2024-04-17T15:15:28.069 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-04-17T15:15:28.070 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32018.log 2024-04-17T15:15:28.070 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-04-17T15:15:28.070 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.22849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32463.log 2024-04-17T15:15:28.070 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22849.log.gz 2024-04-17T15:15:28.072 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-04-17T15:15:28.072 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32018.log.gz 2024-04-17T15:15:28.073 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-04-17T15:15:28.073 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32463.log.gz 2024-04-17T15:15:28.074 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31757.log 2024-04-17T15:15:28.074 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-04-17T15:15:28.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-04-17T15:15:28.075 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2024-04-17T15:15:28.076 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-04-17T15:15:28.076 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31757.log.gz 2024-04-17T15:15:28.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34663.log 2024-04-17T15:15:28.078 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34428.log: 88.4%/var/log/ceph/ceph-client.admin.32904.log: -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-04-17T15:15:28.078 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T15:15:28.079 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-04-17T15:15:28.080 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-04-17T15:15:28.080 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34663.log.gz 2024-04-17T15:15:28.080 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27777.log 2024-04-17T15:15:28.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34194.log 2024-04-17T15:15:28.082 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-04-17T15:15:28.083 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32451.log 2024-04-17T15:15:28.083 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27777.log.gz 2024-04-17T15:15:28.084 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.34194.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32148.log 2024-04-17T15:15:28.085 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34194.log.gz 2024-04-17T15:15:28.085 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34376.log 2024-04-17T15:15:28.085 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32451.log.gz 2024-04-17T15:15:28.086 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33372.log 2024-04-17T15:15:28.086 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32148.log.gz 2024-04-17T15:15:28.087 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32096.log 2024-04-17T15:15:28.088 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34376.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34376.log.gz 2024-04-17T15:15:28.089 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32880.log 2024-04-17T15:15:28.089 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33372.log.gz 2024-04-17T15:15:28.090 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34506.log 2024-04-17T15:15:28.090 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32096.log.gz 2024-04-17T15:15:28.091 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32880.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T15:15:28.091 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32880.log.gz 2024-04-17T15:15:28.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33138.log 2024-04-17T15:15:28.092 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34506.log.gz 2024-04-17T15:15:28.093 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32460.log 2024-04-17T15:15:28.095 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32332.log 2024-04-17T15:15:28.095 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33138.log.gz 2024-04-17T15:15:28.096 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2024-04-17T15:15:28.096 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32460.log.gz 2024-04-17T15:15:28.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-04-17T15:15:28.097 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32332.log.gz 2024-04-17T15:15:28.098 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34220.log 2024-04-17T15:15:28.099 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2024-04-17T15:15:28.100 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32876.log 2024-04-17T15:15:28.100 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-04-17T15:15:28.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-04-17T15:15:28.102 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34220.log.gz 2024-04-17T15:15:28.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-04-17T15:15:28.103 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32876.log.gz 2024-04-17T15:15:28.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T15:15:28.104 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-04-17T15:15:28.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34272.log 2024-04-17T15:15:28.105 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-04-17T15:15:28.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-04-17T15:15:28.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34272.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34272.log.gz 2024-04-17T15:15:28.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33008.log 2024-04-17T15:15:28.109 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-04-17T15:15:28.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33008.log: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T15:15:28.111 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33008.log.gz 2024-04-17T15:15:28.111 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-04-17T15:15:28.113 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34168.log 2024-04-17T15:15:28.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2024-04-17T15:15:28.114 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz 2024-04-17T15:15:28.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34168.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34168.log.gz 2024-04-17T15:15:28.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33294.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 2024-04-17T15:15:28.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-04-17T15:15:28.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32645.log 2024-04-17T15:15:28.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32070.log 2024-04-17T15:15:28.120 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-04-17T15:15:28.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32645.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32645.log.gz 2024-04-17T15:15:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32070.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32070.log.gz 2024-04-17T15:15:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33915.log 2024-04-17T15:15:28.124 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27894.log 2024-04-17T15:15:28.125 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-04-17T15:15:28.125 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33915.log.gz 2024-04-17T15:15:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-04-17T15:15:28.126 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27894.log.gz 2024-04-17T15:15:28.127 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31939.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-04-17T15:15:28.128 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-04-17T15:15:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-04-17T15:15:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33164.log 2024-04-17T15:15:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32202.log 2024-04-17T15:15:28.132 INFO:teuthology.orchestra.run.smithi016.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-04-17T15:15:28.133 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33164.log.gz 2024-04-17T15:15:28.135 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32202.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32202.log.gz 2024-04-17T15:15:28.135 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T15:15:28.136 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34454.log 2024-04-17T15:15:28.139 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33398.log 2024-04-17T15:15:28.139 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34454.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T15:15:28.139 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34454.log.gz 2024-04-17T15:15:28.140 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33398.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33398.log.gz 2024-04-17T15:15:28.140 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-17T15:15:28.141 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T15:15:28.143 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31992.log 2024-04-17T15:15:28.146 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.31992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31992.log.gz 2024-04-17T15:15:28.146 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-04-17T15:15:28.149 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32306.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-04-17T15:15:28.149 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34613.log 2024-04-17T15:15:28.151 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-17T15:15:28.152 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34613.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T15:15:28.152 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34613.log.gz 2024-04-17T15:15:28.152 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-04-17T15:15:28.154 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-17T15:15:28.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34142.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-17T15:15:28.155 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-04-17T15:15:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/valgrind/mds.a.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-17T15:15:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/valgrind/mon.a.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-17T15:15:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-17T15:15:28.159 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-17T15:15:28.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33941.log 2024-04-17T15:15:28.160 INFO:teuthology.orchestra.run.smithi016.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-04-17T15:15:28.162 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/valgrind/mds.e.log: 57.1% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-17T15:15:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33941.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33941.log.gz 2024-04-17T15:15:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-04-17T15:15:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34584.log 2024-04-17T15:15:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32384.log 2024-04-17T15:15:28.167 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-04-17T15:15:28.167 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34584.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34584.log.gz 2024-04-17T15:15:28.168 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32384.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32384.log.gz 2024-04-17T15:15:28.169 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33572.log 2024-04-17T15:15:28.170 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-04-17T15:15:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.33572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32646.log 2024-04-17T15:15:28.171 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33572.log.gz 2024-04-17T15:15:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-04-17T15:15:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32646.log.gz 2024-04-17T15:15:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32701.log 2024-04-17T15:15:28.175 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33969.log 2024-04-17T15:15:28.177 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33060.log 2024-04-17T15:15:28.177 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32701.log.gz 2024-04-17T15:15:28.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33969.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33969.log.gz 2024-04-17T15:15:28.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33060.log.gz 2024-04-17T15:15:28.179 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34741.log 2024-04-17T15:15:28.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33190.log 2024-04-17T15:15:28.182 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-04-17T15:15:28.182 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34741.log.gz 2024-04-17T15:15:28.183 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33190.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33190.log.gz 2024-04-17T15:15:28.184 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32448.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-04-17T15:15:28.185 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31966.log 2024-04-17T15:15:28.186 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32918.log 2024-04-17T15:15:28.188 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-04-17T15:15:28.188 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31966.log.gz 2024-04-17T15:15:28.188 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32918.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32918.log.gz 2024-04-17T15:15:28.189 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34324.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-04-17T15:15:28.190 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33242.log 2024-04-17T15:15:28.191 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-04-17T15:15:28.193 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33242.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-17T15:15:28.193 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33242.log.gz 2024-04-17T15:15:28.193 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32461.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-04-17T15:15:28.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32850.log 2024-04-17T15:15:28.198 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31830.log 2024-04-17T15:15:28.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32850.log.gz 2024-04-17T15:15:28.201 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31830.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31830.log.gz 2024-04-17T15:15:28.203 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-17T15:15:28.354 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T15:15:28.474 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T15:15:28.561 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T15:15:28.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-17T15:15:28.780 INFO:teuthology.orchestra.run.smithi016.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T15:15:28.984 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T15:15:28.984 INFO:teuthology.orchestra.run.smithi067.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T15:15:29.129 INFO:teuthology.orchestra.run.smithi067.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T15:15:29.166 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T15:15:29.250 INFO:teuthology.orchestra.run.smithi016.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T15:15:29.366 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T15:15:29.488 INFO:teuthology.orchestra.run.smithi067.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T15:15:29.535 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T15:15:29.539 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-17T15:15:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m1.535s 2024-04-17T15:15:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m5.228s 2024-04-17T15:15:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.570s 2024-04-17T15:15:40.769 INFO:teuthology.orchestra.run.smithi067.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-17T15:15:40.771 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-17T15:15:40.771 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m12.758s 2024-04-17T15:15:40.771 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m18.258s 2024-04-17T15:15:40.771 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.571s 2024-04-17T15:15:40.771 INFO:tasks.ceph:Archiving logs... 2024-04-17T15:15:40.771 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi016/log 2024-04-17T15:15:40.773 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T15:15:41.484 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi067/log 2024-04-17T15:15:41.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T15:15:43.757 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun 2024-04-17T15:15:43.758 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T15:15:43.766 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun 2024-04-17T15:15:43.767 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T15:15:43.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T15:15:43.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T15:15:43.837 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T15:15:43.846 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T15:15:43.847 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:15:43.850 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:15:43.862 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:15:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-17T15:15:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 39 64 377 0.084 -2.294 0.145 2024-04-17T15:15:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.093 +0.822 0.333 2024-04-17T15:15:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:*hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.114 -0.158 0.180 2024-04-17T15:15:43.863 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout:+hv01.front.sepi 67.205.162.81 3 u 35 64 377 0.078 -2.908 0.588 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 377 0.100 -0.011 0.647 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout:*hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.082 -1.404 0.537 2024-04-17T15:15:43.864 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-17T15:15:43.865 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T15:15:43.873 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T15:15:43.874 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T15:15:43.882 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T15:15:43.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T15:15:43.898 INFO:teuthology.task.internal:Duration was 3462.480679 seconds 2024-04-17T15:15:43.898 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T15:15:43.907 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T15:15:43.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T15:15:43.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T15:15:43.999 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T15:15:43.999 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-17T15:15:43.999 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T15:15:44.020 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-04-17T15:15:44.020 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T15:15:44.031 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T15:15:44.031 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T15:15:44.064 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T15:15:44.100 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T15:15:44.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T15:15:44.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T15:15:44.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T15:15:44.224 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T15:15:44.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T15:15:44.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T15:15:44.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T15:15:44.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:15:44.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:15:44.307 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-17T15:15:44.310 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-04-17T15:15:44.334 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:15:44.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:15:44.380 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:15:44.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:15:44.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T15:15:44.394 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T15:15:44.395 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi016 2024-04-17T15:15:44.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T15:15:44.447 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270/remote/smithi067 2024-04-17T15:15:44.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T15:15:44.469 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T15:15:44.469 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T15:15:44.491 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T15:15:44.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T15:15:44.524 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T15:15:44.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T15:15:44.534 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T15:15:44.534 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T15:15:44.543 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T15:15:44.549 INFO:teuthology.orchestra.run.smithi016.stdout: 658120 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 15:15 /home/ubuntu/cephtest 2024-04-17T15:15:44.562 INFO:teuthology.orchestra.run.smithi067.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 15:15 /home/ubuntu/cephtest 2024-04-17T15:15:44.563 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T15:15:44.573 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T15:15:44.582 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun 2024-04-17T15:15:44.582 INFO:teuthology.nuke:Checking targets against current locks 2024-04-17T15:15:44.605 DEBUG:teuthology.nuke:shortname: smithi016 2024-04-17T15:15:44.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T15:15:44.626 DEBUG:teuthology.nuke:shortname: smithi067 2024-04-17T15:15:44.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T15:15:44.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 14:08:30.173082', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCguLNMjncNpz3o8bS4UCM/sfrcef8c9AeqG0eeeU/AC/EJGgI4itrWpW0/vBSK0A5pdATltOpCH1kaC3XBgJ/A='} 2024-04-17T15:15:44.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 14:08:30.175219', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtWG/r9XJQPeirGxJkjuzuMQpohPhCmGWLUGaEICj/xQl6TXT4bI8S9NLapM9mz/Bag3vdgJrTvwIgO2v+1CXk='} 2024-04-17T15:15:44.680 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-17T15:15:44.680 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T15:15:44.705 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-17T15:15:44.706 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:44.720 INFO:teuthology.orchestra.console.smithi067:Power off 2024-04-17T15:15:44.720 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T15:15:44.728 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-17T15:15:44.741 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-04-17T15:15:44.742 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:44.762 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-17T15:15:48.729 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:48.763 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:48.841 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-17T15:15:48.873 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-17T15:15:52.847 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:52.874 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:52.956 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-17T15:15:52.983 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-04-17T15:15:53.083 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-04-17T15:15:56.959 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T15:15:57.068 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-17T15:15:57.169 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-17T15:15:57.273 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 3462.4806785583496 failure_reason: 'valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2024-04-17T15:15:57.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:15:57.351 INFO:teuthology.run:FAIL